[ 522.498760] env[65019]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.498760] env[65019]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.471554] env[65107]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.471554] env[65107]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 525.057012] env[65107]: INFO neutron.common.config [-] Logging enabled! [ 525.057349] env[65107]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev74 [ 525.057585] env[65107]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65107) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 525.057916] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 525.058020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 525.058828] env[65107]: WARNING oslo_policy.policy [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.059056] env[65107]: WARNING oslo_policy.policy [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.060928] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] VMware NSXv3 Agent initialized successfully. [ 525.061202] env[65107]: DEBUG oslo_concurrency.lockutils [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] Acquiring lock "singleton_lock" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.061319] env[65107]: DEBUG oslo_concurrency.lockutils [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] Acquired lock "singleton_lock" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.061532] env[65107]: DEBUG oslo_concurrency.lockutils [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] Releasing lock "singleton_lock" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.061821] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] Full set of CONF: {{(pid=65107) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 525.061930] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ******************************************************************************** {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 525.062042] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] Configuration options gathered from: {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 525.062382] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 525.062617] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 525.062721] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ================================================================================ {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 525.062895] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] agent_down_time = 75 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063047] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] allow_automatic_dhcp_failover = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063183] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] allow_bulk = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063324] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] api_extensions_path = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063462] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] api_paste_config = api-paste.ini {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063602] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] auth_strategy = keystone {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063704] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] backdoor_port = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063803] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] backdoor_socket = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.063934] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] backlog = 4096 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.064137] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.064315] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] bind_host = 0.0.0.0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.064457] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] bind_port = 9696 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.064594] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] client_socket_timeout = 900 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.064731] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] config_dir = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.064835] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.064969] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] config_source = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.065120] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] control_exchange = neutron {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.065255] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] core_plugin = ml2 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.065391] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] debug = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.065525] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] default_availability_zones = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.065759] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.065913] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] dhcp_agent_notification = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066075] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] dhcp_agents_per_network = 1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066177] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] dhcp_lease_duration = 86400 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066313] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] dhcp_load_type = networks {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066446] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] dns_domain = openstacklocal {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066580] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066709] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] enable_default_route_bfd = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066885] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] enable_default_route_ecmp = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.066959] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] enable_dvr = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.067099] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] enable_new_agents = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.067247] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.067379] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] enable_signals = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.067527] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] enable_traditional_dhcp = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.067656] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] external_dns_driver = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.067783] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] filter_validation = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.067922] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] global_physnet_mtu = 8950 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.068060] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] graceful_shutdown_timeout = 60 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.068234] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] host = cpu-1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.068367] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] host_dvr_for_dhcp = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.068522] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] http_retries = 3 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.068691] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] instance_format = [instance: %(uuid)s] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.068849] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.068985] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ipam_driver = internal {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.069492] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ipv6_pd_enabled = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.069645] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] l3_ha = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.069789] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.069928] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] l3_ha_network_physical_name = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070080] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] l3_ha_network_type = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070228] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_color = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070364] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_config_append = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070500] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_dir = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070757] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_file = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070871] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_options = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.070976] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_rotate_interval = 1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.071131] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_rotate_interval_type = days {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.071264] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] log_rotation_type = none {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.071376] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.071495] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.071667] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.071829] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.071925] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.072081] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] max_dns_nameservers = 5 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.072214] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] max_header_line = 16384 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.072372] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] max_l3_agents_per_router = 3 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.072808] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] max_logfile_count = 30 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.072808] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] max_logfile_size_mb = 200 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.072917] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] max_subnet_host_routes = 20 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.073049] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] my_ip = 10.180.1.21 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.073164] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] my_ipv6 = ::1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.073362] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] network_auto_schedule = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.073543] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] network_link_prefix = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.073697] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.073865] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] notify_nova_on_port_data_changes = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.074097] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] notify_nova_on_port_status_changes = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.074265] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] pagination_max_limit = -1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.074405] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] publish_errors = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.074541] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] rate_limit_burst = 0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.074678] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] rate_limit_except_level = CRITICAL {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.074811] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] rate_limit_interval = 0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.074940] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] retry_until_window = 30 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.075083] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] router_distributed = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.075216] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] rpc_resources_processing_step = 20 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.075361] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] rpc_response_max_timeout = 600 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.075539] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] rpc_response_timeout = 60 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.075691] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] send_events_interval = 2 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.075826] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] service_plugins = ['router'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.075967] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] setproctitle = on {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.076113] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] shell_completion = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.076253] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] state_path = /opt/stack/data/neutron {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.076394] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] syslog_log_facility = LOG_USER {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.076527] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] tcp_keepidle = 600 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.076660] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] transport_url = **** {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.076811] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] use_journal = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.076934] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] use_json = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.077125] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] use_ssl = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.077238] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] use_stderr = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.077384] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] use_syslog = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.077544] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] vlan_qinq = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.077678] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] vlan_transparent = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.077807] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] watch_log_file = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.077932] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] wsgi_default_pool_size = 100 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.078100] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] wsgi_keep_alive = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.078827] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.078827] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] wsgi_server_debug = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.078827] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_concurrency.disable_process_locking = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.078827] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.078997] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.079162] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.079306] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081390] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081390] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081390] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.connection_string = messaging:// {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081390] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.enabled = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081390] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.es_doc_type = notification {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081390] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.es_scroll_size = 10000 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.es_scroll_time = 2m {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.filter_error_trace = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.hmac_keys = **** {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.sentinel_service_name = mymaster {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.socket_timeout = 0.1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.trace_requests = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081631] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler.trace_sqlalchemy = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.081827] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler_jaeger.process_tags = {} {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.082391] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler_jaeger.service_name_prefix = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.082576] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] profiler_otlp.service_name_prefix = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.082756] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.enforce_new_defaults = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.083061] env[65107]: WARNING oslo_config.cfg [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 525.083223] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.enforce_scope = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084472] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.policy_default_rule = default {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084472] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084472] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084472] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084472] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084472] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084778] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084778] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084778] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084778] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084778] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] agent.extensions = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.084914] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085083] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] service_providers.service_provider = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085172] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.default_quota = -1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085413] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085496] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_floatingip = 50 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085586] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_network = 100 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085717] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_port = 500 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085848] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.085978] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_router = 10 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.086126] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_security_group = 10 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.086259] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087337] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.quota_subnet = 100 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087337] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] QUOTAS.track_quota_usage = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087337] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087337] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep.group = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087337] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep.helper_command = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087337] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep.log_daemon_traceback = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087337] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087775] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep.thread_pool_size = 8 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087775] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep.user = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087775] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087775] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_dhcp_release.group = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.087963] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_dhcp_release.helper_command = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.088142] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.088291] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.088431] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.088586] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_dhcp_release.user = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.088736] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.088886] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_ovs_vsctl.group = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.089055] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.089195] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.089336] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.089511] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.089692] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_ovs_vsctl.user = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.089883] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_namespace.capabilities = [21] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090034] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_namespace.group = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090173] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_namespace.helper_command = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090306] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090445] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090582] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090710] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_namespace.user = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090847] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_conntrack.capabilities = [12] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.090973] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_conntrack.group = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.091113] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_conntrack.helper_command = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.091243] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.091377] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.091512] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.091642] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_conntrack.user = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.091831] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_link.capabilities = [12, 21] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.091906] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_link.group = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.092040] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_link.helper_command = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.092204] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_link.log_daemon_traceback = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.092347] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.092484] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_link.thread_pool_size = 8 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.092638] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] privsep_link.user = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.092832] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.092985] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.093295] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.continue_on_failed_promotions = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.093369] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.dscp = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.093462] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.dscp_inherit = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.093614] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.force_mp_to_policy = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.093774] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.locking_coordinator_url = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.093934] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.log_agent_heartbeats = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.094079] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.logging_expire = 1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.094736] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.094736] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.094736] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.polling_interval = 240 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.094736] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.094897] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.094980] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.report_interval = 30.0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.095096] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.095233] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.095373] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.095505] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.sync_skew = 60 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.095644] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.synchronization_queue_size = 20 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.095782] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT.use_helper_for_ns_read = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.095924] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] SECURITYGROUP.enable_ipset = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.096082] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] SECURITYGROUP.enable_security_group = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.096521] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.096521] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.096521] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] experimental.ipv6_pd_enabled = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.096674] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.extension_drivers = ['port_security'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.096783] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.external_network_type = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097375] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097375] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.overlay_ip_version = 4 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097375] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.path_mtu = 8950 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097375] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.physical_network_mtus = {} {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097587] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097664] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097774] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ml2.type_drivers = ['vlan'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.097917] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.098056] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.098187] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.098980] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.098980] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.098980] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.098980] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.098980] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.099297] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.099297] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.099397] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_login_password = **** {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.099555] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.099701] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_login_user = admin {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.099854] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100041] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100153] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100285] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100426] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100573] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100714] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100851] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.100984] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.101138] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.101301] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.101526] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.101776] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.102102] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.102335] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.102506] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.102650] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.102795] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.auth_section = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.102945] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.auth_type = password {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.103110] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.103249] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.certfile = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.103388] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.collect_timing = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.103535] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.endpoint_type = public {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.103673] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.insecure = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.103803] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.keyfile = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.103944] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.region_name = RegionOne {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.104091] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.split_loggers = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.104226] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] nova.timeout = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.104363] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.auth_section = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.104505] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.auth_type = password {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.104642] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.104774] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.certfile = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.104909] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.collect_timing = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.105059] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.endpoint_type = public {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.105196] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.insecure = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.105325] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.keyfile = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.105454] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.region_name = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.105592] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.split_loggers = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.105718] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] placement.timeout = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.105954] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.auth_section = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.106117] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.auth_type = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.106251] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.cafile = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.106382] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.certfile = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.106519] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.collect_timing = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.106650] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.connect_retries = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.106778] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.connect_retry_delay = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.106911] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.enable_notifications = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.107050] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.endpoint_override = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.107185] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.insecure = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.107313] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.interface = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.107465] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.keyfile = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.107608] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.max_version = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.107740] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.min_version = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.107871] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.region_name = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108009] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.retriable_status_codes = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108146] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.service_name = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108275] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.service_type = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108423] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.split_loggers = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108564] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.status_code_retries = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108695] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.status_code_retry_delay = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108825] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.timeout = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.108956] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.valid_interfaces = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.109129] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ironic.version = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.109229] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] cli_script.dry_run = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.109371] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.109503] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.109639] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.109775] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.109910] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.110058] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.110196] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.110331] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.110468] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.110609] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.110739] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.110879] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111026] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111166] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111299] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111761] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111761] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111761] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111856] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.111939] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.112128] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.112273] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.112410] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.112546] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.112680] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.112815] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.112949] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.113096] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.113228] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.113359] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.113494] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.ssl = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.113636] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.113775] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.113911] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114061] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114200] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114330] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114474] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_notifications.driver = [] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114612] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_notifications.retry = -1 {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114762] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114895] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.114999] env[65107]: DEBUG oslo_service.backend._eventlet.service [None req-cb3f5711-e3cf-4dc5-a807-dbb260bbbf98 None None] ******************************************************************************** {{(pid=65107) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 525.116156] env[65107]: DEBUG neutron.agent.securitygroups_rpc [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Init firewall settings (driver=nsxv3) {{(pid=65107) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 525.117528] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65107) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 525.117778] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] RPC agent_id: nsxm-l-01a.corp.local [ 525.120044] env[65107]: DEBUG dogpile.cache.region [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.120173] env[65107]: DEBUG dogpile.lock [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 525.120284] env[65107]: DEBUG dogpile.lock [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 525.120385] env[65107]: DEBUG dogpile.lock [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 525.120481] env[65107]: DEBUG dogpile.cache.region [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.120571] env[65107]: DEBUG dogpile.lock [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 525.120697] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 525.144709] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Session token - acquiring [ 525.146335] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.146655] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.146756] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.147171] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.157955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.449636] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 525.467170] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 525.467338] env[65107]: DEBUG dogpile.cache.region [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Cache value generated in 0.347 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 525.467486] env[65107]: DEBUG dogpile.lock [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 525.467606] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Activating Policy API Provider. [ 525.467802] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Looking for the default Infrastructure Rules. [ 525.533773] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Looking for the Default Layer3 Logged Drop Section. [ 525.550319] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 525.550790] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.550960] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.551075] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.551360] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.551698] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.066369] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.569250] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.071480] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Inventory metadata is going to be refreshed. [ 527.072213] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.796200] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.796465] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.796510] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.796811] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.808687] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.809586] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.810254] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.831784] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.832049] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.832049] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.832367] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.832490] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.832635] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.832750] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.832853] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 527.852732] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.852941] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.852993] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.853287] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.853458] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.853600] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 527.873302] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.873505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.873562] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.873857] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.874020] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.874173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 527.896673] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.896887] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.896969] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.897309] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.897529] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.897691] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 527.897784] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.897884] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 527.915562] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.915833] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.915833] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.916142] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.916267] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.916411] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 527.916513] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.916613] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 527.936313] env[65107]: DEBUG networking_nsxv3.common.locking [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.936550] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.936596] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.936885] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.937035] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.937190] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 527.937294] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.937404] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Inventory metadata have been refreshed. [ 527.937682] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Dryrun:True. Metadata refresh completed. [ 527.937828] env[65107]: DEBUG oslo_concurrency.lockutils [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Releasing lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.939620] env[65107]: INFO neutron.agent.agent_extensions_manager [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Loaded agent extensions: [] [ 527.940560] env[65107]: DEBUG neutron_lib.callbacks.manager [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65107) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 527.993562] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent RPC Daemon Started! [ 527.993669] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent loop - iteration:0 started [ 527.993769] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent out of sync with plugin! [ 530.945794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.945794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.945794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.945794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.945794] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.449272] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.950551] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 532.452485] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 532.452668] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 532.941187] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.941350] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 533.162832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.163330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.163330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.163330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.175136] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 533.175938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.176620] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 533.198160] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.198358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.198358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.198543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.198635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.198741] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 533.198813] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.198880] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 533.220321] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.220590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.220590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.220790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.220865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.220946] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 533.243111] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.243335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.243335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.243511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.243619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.243727] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 533.262351] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.262603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.262603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.262746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.262853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.262971] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 533.263062] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.263156] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 533.281314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.281606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.281606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.281830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.281830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.282087] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 533.282087] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.282087] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 533.302199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.302525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.302525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.302752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.302907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.303085] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 533.303202] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.303320] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 533.303432] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 533.303545] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 533.303631] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 533.303839] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 533.304219] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 533.304329] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 533.304435] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 533.325097] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.325398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.325398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.325593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.325729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.325861] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 533.345846] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.346074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.346074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.346255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.346357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.361600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.942994] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.942994] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.944653] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.944990] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.105691] env[65107]: INFO networking_nsxv3.common.synchronization [None req-8eadb563-1abe-4a9d-84da-b4af893c5e36 demo admin] Enqueued Resource ID: ed9c64ca-575c-4b67-bc35-4f138f2d5b87 with Priority: HIGHEST for action security_group_rules [ 543.106228] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed9c64ca-575c-4b67-bc35-4f138f2d5b87 with Priority: HIGHEST for action security_group_rules [ 543.106655] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed9c64ca-575c-4b67-bc35-4f138f2d5b87 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.106834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed9c64ca-575c-4b67-bc35-4f138f2d5b87" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.106940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed9c64ca-575c-4b67-bc35-4f138f2d5b87" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.107351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed9c64ca-575c-4b67-bc35-4f138f2d5b87" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.107496] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed9c64ca-575c-4b67-bc35-4f138f2d5b87',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.630755] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.630999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.630999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.631214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.631306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.631403] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed9c64ca-575c-4b67-bc35-4f138f2d5b87 already deleted. [ 543.631487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed9c64ca-575c-4b67-bc35-4f138f2d5b87" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.106927] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.107318] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.108350] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.108350] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.108418] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.109199] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.111347] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.111692] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.999116] env[65107]: INFO networking_nsxv3.common.synchronization [None req-93712686-2e9f-4a2b-83cd-f96d6868bcda None None] Enqueued Resource ID: 822e1e88-99f1-4787-829f-bcc1350304f2 with Priority: HIGHEST for action port [ 567.999660] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e1e88-99f1-4787-829f-bcc1350304f2 with Priority: HIGHEST for action port [ 568.000139] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-822e1e88-99f1-4787-829f-bcc1350304f2 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.000290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-822e1e88-99f1-4787-829f-bcc1350304f2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.000363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-822e1e88-99f1-4787-829f-bcc1350304f2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.001030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-822e1e88-99f1-4787-829f-bcc1350304f2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.001030] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('822e1e88-99f1-4787-829f-bcc1350304f2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.505749] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 822e1e88-99f1-4787-829f-bcc1350304f2 [ 568.506182] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.506419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.506709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.507019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.507135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.507226] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:822e1e88-99f1-4787-829f-bcc1350304f2 already deleted. [ 568.507310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-822e1e88-99f1-4787-829f-bcc1350304f2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.613294] env[65107]: INFO networking_nsxv3.common.synchronization [None req-dc7f5316-2b6a-43ad-9327-36bea41aa162 None None] Enqueued Resource ID: c44030fd-584e-4a84-8509-2c4aaa92a9ac with Priority: HIGHEST for action port [ 569.613884] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c44030fd-584e-4a84-8509-2c4aaa92a9ac with Priority: HIGHEST for action port [ 569.614450] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c44030fd-584e-4a84-8509-2c4aaa92a9ac taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.614586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c44030fd-584e-4a84-8509-2c4aaa92a9ac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.614677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c44030fd-584e-4a84-8509-2c4aaa92a9ac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.615328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c44030fd-584e-4a84-8509-2c4aaa92a9ac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.615328] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c44030fd-584e-4a84-8509-2c4aaa92a9ac',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.117722] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c44030fd-584e-4a84-8509-2c4aaa92a9ac [ 570.118099] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.118250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.118320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.118545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.118671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.118797] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c44030fd-584e-4a84-8509-2c4aaa92a9ac already deleted. [ 570.118848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c44030fd-584e-4a84-8509-2c4aaa92a9ac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.615404] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 574.615749] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.281224] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3fcd9227-df29-4bc8-80ae-2f9628799605 None None] Enqueued Resource ID: 1533657f-b765-4b99-b77e-53be4beff1ce with Priority: HIGHEST for action port [ 575.281839] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1533657f-b765-4b99-b77e-53be4beff1ce with Priority: HIGHEST for action port [ 575.282220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-1533657f-b765-4b99-b77e-53be4beff1ce taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.282790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1533657f-b765-4b99-b77e-53be4beff1ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.282790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1533657f-b765-4b99-b77e-53be4beff1ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.282993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1533657f-b765-4b99-b77e-53be4beff1ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.283172] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1533657f-b765-4b99-b77e-53be4beff1ce',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.787026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1533657f-b765-4b99-b77e-53be4beff1ce [ 575.787026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.787026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.787026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.787431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.787431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.787431] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1533657f-b765-4b99-b77e-53be4beff1ce already deleted. [ 575.787871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1533657f-b765-4b99-b77e-53be4beff1ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.824438] env[65107]: INFO networking_nsxv3.common.synchronization [req-68463b4c-ebfb-4bc6-91a5-7741d16df3a9 req-a220896f-0e56-4859-b3cf-44e0d5a24a3c tempest-TenantUsagesTestJSON-2137230175 tempest-TenantUsagesTestJSON-2137230175-project-member] Enqueued Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_members [ 575.828231] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_members [ 575.828231] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.828231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.828231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.828231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.828231] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.828231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.828231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.828231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.828231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.828231] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.972328] env[65107]: INFO networking_nsxv3.common.synchronization [None req-39ca3549-40f2-4d8e-b7f9-b59cc7f71c06 None None] Enqueued Resource ID: 067bca79-2cd5-4424-b097-d401fc7b4669 with Priority: HIGHEST for action port [ 575.973033] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 067bca79-2cd5-4424-b097-d401fc7b4669 with Priority: HIGHEST for action port [ 575.973033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-067bca79-2cd5-4424-b097-d401fc7b4669 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.973033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-067bca79-2cd5-4424-b097-d401fc7b4669" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.973033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-067bca79-2cd5-4424-b097-d401fc7b4669" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.973842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-067bca79-2cd5-4424-b097-d401fc7b4669" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.973842] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067bca79-2cd5-4424-b097-d401fc7b4669',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.329983] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.330189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.330278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.330468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.330559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.330748] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.330844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.330905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.331061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.331139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.331223] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 already deleted. [ 576.331360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.476380] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 067bca79-2cd5-4424-b097-d401fc7b4669 [ 576.476627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.476769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.476840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.477702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.477702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.477702] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:067bca79-2cd5-4424-b097-d401fc7b4669 already deleted. [ 576.477702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-067bca79-2cd5-4424-b097-d401fc7b4669" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.294167] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.294419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.294419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.294776] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.294975] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.295158] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.295968] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.296313] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.296452] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.296785] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 577.296852] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 577.296961] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 577.297089] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 577.297196] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 577.297704] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 577.297704] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 577.319353] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 577.319530] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 577.319667] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 577.319877] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.320219] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-3ded65ff-3082-4436-a7b5-e5c653e0db06 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.320458] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.320531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.323839] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.323839] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ded65ff-3082-4436-a7b5-e5c653e0db06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.402432] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4ac38aca-3427-4e07-bb92-171252cdc082 None None] Enqueued Resource ID: 15260147-3306-4777-b21f-4a9486bb083e with Priority: HIGHEST for action port [ 577.402692] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15260147-3306-4777-b21f-4a9486bb083e with Priority: HIGHEST for action port [ 577.403269] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-15260147-3306-4777-b21f-4a9486bb083e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.403389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15260147-3306-4777-b21f-4a9486bb083e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.403450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15260147-3306-4777-b21f-4a9486bb083e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.403681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15260147-3306-4777-b21f-4a9486bb083e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.403759] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15260147-3306-4777-b21f-4a9486bb083e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.825560] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.825743] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.825743] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.826167] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.826375] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.826572] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 3ded65ff-3082-4436-a7b5-e5c653e0db06 not found, creating... [ 577.827147] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.827147] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.827280] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.827536] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.827717] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.828132] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.828349] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.828439] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.828734] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.828782] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.829112] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 3ded65ff-3082-4436-a7b5-e5c653e0db06 is going to be created. [ 577.860373] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.860539] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.861127] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.861127] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.861389] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.861464] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.907269] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15260147-3306-4777-b21f-4a9486bb083e [ 577.907269] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.907269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.907269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.907269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.907269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.907269] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15260147-3306-4777-b21f-4a9486bb083e already deleted. [ 577.907656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15260147-3306-4777-b21f-4a9486bb083e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.932363] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4e247db2-a5e8-4d51-ad4b-796e97090572 None None] Enqueued Resource ID: 56177340-ba35-439d-b009-1ac93ba2dbc1 with Priority: HIGHEST for action port [ 577.933326] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56177340-ba35-439d-b009-1ac93ba2dbc1 with Priority: HIGHEST for action port [ 577.933608] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-56177340-ba35-439d-b009-1ac93ba2dbc1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.933741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56177340-ba35-439d-b009-1ac93ba2dbc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.933810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56177340-ba35-439d-b009-1ac93ba2dbc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.934083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56177340-ba35-439d-b009-1ac93ba2dbc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.934167] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56177340-ba35-439d-b009-1ac93ba2dbc1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.436984] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56177340-ba35-439d-b009-1ac93ba2dbc1 [ 578.437203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.437332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.437403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.437665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.437770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.437867] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56177340-ba35-439d-b009-1ac93ba2dbc1 already deleted. [ 578.437947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56177340-ba35-439d-b009-1ac93ba2dbc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.677954] env[65107]: INFO networking_nsxv3.common.synchronization [req-68463b4c-ebfb-4bc6-91a5-7741d16df3a9 req-fc213b44-1bb6-45a7-bc94-e94d13d95bf9 service nova] Enqueued Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_rules [ 578.677954] env[65107]: INFO networking_nsxv3.common.synchronization [req-68463b4c-ebfb-4bc6-91a5-7741d16df3a9 req-fc213b44-1bb6-45a7-bc94-e94d13d95bf9 service nova] Enqueued Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_members [ 578.678208] env[65107]: INFO networking_nsxv3.common.synchronization [req-68463b4c-ebfb-4bc6-91a5-7741d16df3a9 req-fc213b44-1bb6-45a7-bc94-e94d13d95bf9 service nova] Enqueued Resource ID: 3ded65ff-3082-4436-a7b5-e5c653e0db06 with Priority: HIGHEST for action port [ 578.678628] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_rules [ 578.678852] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_members [ 578.678958] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ded65ff-3082-4436-a7b5-e5c653e0db06 with Priority: HIGHEST for action port [ 578.679251] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.679360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.679422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.679668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.679746] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.680584] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.680695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.680841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.680930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.681083] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.681178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.681240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.681378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.681483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.681550] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.684209] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ded65ff-3082-4436-a7b5-e5c653e0db06 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.684209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.684209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.684209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.684209] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ded65ff-3082-4436-a7b5-e5c653e0db06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.185889] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.186113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.199424] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ded65ff-3082-4436-a7b5-e5c653e0db06 with status ACTIVE [ 579.199830] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.199830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.199830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.200215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.200215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.200378] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.200455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.200492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.200666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.200718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.200888] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.200983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.201049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.201237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.201296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.201336] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ded65ff-3082-4436-a7b5-e5c653e0db06 is going to be updated. [ 579.202443] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.228258] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.228405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.228476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.228811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.228997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.229255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ded65ff-3082-4436-a7b5-e5c653e0db06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.303185] env[65107]: INFO networking_nsxv3.common.synchronization [req-0acfe808-5efb-432b-9219-9711f17ca4cd req-8f9b0c70-34d4-44af-9073-3b0a3fd1cc4c tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 579.303795] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 579.304600] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.304796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.304873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.305154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.305324] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.305457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.305702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.306165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.306392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.306509] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.704160] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.811417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.811573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.811654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.811961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.812100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.812313] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.812412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.812461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.812644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.812714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.812762] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 already deleted. [ 579.812837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.206886] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.207078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.207148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.207938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.208066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.208207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 is going to be created. [ 580.238327] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.238494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.238593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.238849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.239013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.250597] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 in Status: UNINITIALIZED for 2s [ 580.317418] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.317648] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.317817] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.318864] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.318864] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.318864] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.318864] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.319126] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.321900] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.322314] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 580.323604] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 580.323604] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 580.323604] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 580.323604] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 580.323604] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 580.323604] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 580.347333] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 580.347650] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 580.347894] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 580.348136] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.348660] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-8c434d9e-64b3-407e-9622-69eea6f1630a taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.349964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.349964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.349964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.349964] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c434d9e-64b3-407e-9622-69eea6f1630a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.559471] env[65107]: INFO networking_nsxv3.common.synchronization [None req-427e1095-4ebc-4305-874d-5c2e1b403d33 None None] Enqueued Resource ID: 97531f06-ed86-4b3b-be6b-275874e10536 with Priority: HIGHEST for action port [ 580.559741] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97531f06-ed86-4b3b-be6b-275874e10536 with Priority: HIGHEST for action port [ 580.560341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-97531f06-ed86-4b3b-be6b-275874e10536 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.560468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97531f06-ed86-4b3b-be6b-275874e10536" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.560539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97531f06-ed86-4b3b-be6b-275874e10536" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.560783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97531f06-ed86-4b3b-be6b-275874e10536" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.560854] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97531f06-ed86-4b3b-be6b-275874e10536',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.820016] env[65107]: INFO networking_nsxv3.common.synchronization [None req-59ee93df-e46e-45e2-93dc-57b1a1d22b25 None None] Enqueued Resource ID: 76258c23-17d9-41b0-ba52-09a14774d6f0 with Priority: HIGHEST for action port [ 580.821046] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76258c23-17d9-41b0-ba52-09a14774d6f0 with Priority: HIGHEST for action port [ 580.821046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-76258c23-17d9-41b0-ba52-09a14774d6f0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.821046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76258c23-17d9-41b0-ba52-09a14774d6f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.821255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76258c23-17d9-41b0-ba52-09a14774d6f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.821344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76258c23-17d9-41b0-ba52-09a14774d6f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.821432] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76258c23-17d9-41b0-ba52-09a14774d6f0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.853128] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.853355] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.853479] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.853755] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.853906] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.854068] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 8c434d9e-64b3-407e-9622-69eea6f1630a not found, creating... [ 580.854330] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.854483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.854596] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.854836] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.854972] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.855261] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.855413] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.855545] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.855794] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.855930] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.856165] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 8c434d9e-64b3-407e-9622-69eea6f1630a is going to be created. [ 580.877283] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.877500] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.877620] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.877906] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.878148] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.878379] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.064232] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97531f06-ed86-4b3b-be6b-275874e10536 [ 581.064481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.064618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.064693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.064886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.064976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.065083] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97531f06-ed86-4b3b-be6b-275874e10536 already deleted. [ 581.065162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97531f06-ed86-4b3b-be6b-275874e10536" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.324420] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76258c23-17d9-41b0-ba52-09a14774d6f0 [ 581.324648] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.324795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.324863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.325081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.325174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.325271] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76258c23-17d9-41b0-ba52-09a14774d6f0 already deleted. [ 581.325354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76258c23-17d9-41b0-ba52-09a14774d6f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.947312] env[65107]: INFO networking_nsxv3.common.synchronization [req-0acfe808-5efb-432b-9219-9711f17ca4cd req-cb27750f-d1c3-4590-be06-61916c944e60 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 581.947312] env[65107]: INFO networking_nsxv3.common.synchronization [req-0acfe808-5efb-432b-9219-9711f17ca4cd req-cb27750f-d1c3-4590-be06-61916c944e60 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 581.947866] env[65107]: INFO networking_nsxv3.common.synchronization [req-0acfe808-5efb-432b-9219-9711f17ca4cd req-cb27750f-d1c3-4590-be06-61916c944e60 service nova] Enqueued Resource ID: 8c434d9e-64b3-407e-9622-69eea6f1630a with Priority: HIGHEST for action port [ 581.947972] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 581.948096] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 581.948203] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c434d9e-64b3-407e-9622-69eea6f1630a with Priority: HIGHEST for action port [ 581.948461] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.948576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.948655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.949789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.949906] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.950827] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.950948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.951022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.951514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.951514] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.951514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.951967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.951967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.953104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.953104] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.954120] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c434d9e-64b3-407e-9622-69eea6f1630a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.954120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.954120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.954376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.954565] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c434d9e-64b3-407e-9622-69eea6f1630a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.266192] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 in Status: SUCCESS [ 582.266192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.266364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.266620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.266822] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.266938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.267014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.267170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.267246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.267387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.267433] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.459314] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c434d9e-64b3-407e-9622-69eea6f1630a with status ACTIVE [ 582.459314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.459314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.459314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.459314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.459314] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c434d9e-64b3-407e-9622-69eea6f1630a is going to be updated. [ 582.460375] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.461872] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.462048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.483137] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.483350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.483474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.483984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.484318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.484897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c434d9e-64b3-407e-9622-69eea6f1630a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.770435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.770686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.770686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.770751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.770929] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.771058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.771130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.771297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.771388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.771474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.771711] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.771711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.771821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.771895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.772042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.772426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.772593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.772759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.773089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.773256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.773599] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.844310] env[65107]: INFO networking_nsxv3.common.synchronization [None req-72d5a396-3ed7-4b37-a52e-497198602488 None None] Enqueued Resource ID: 4d3f5d67-03d3-4ccb-9806-fbc102a426f0 with Priority: HIGHEST for action port [ 582.844855] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3f5d67-03d3-4ccb-9806-fbc102a426f0 with Priority: HIGHEST for action port [ 582.845180] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d3f5d67-03d3-4ccb-9806-fbc102a426f0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.845563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d3f5d67-03d3-4ccb-9806-fbc102a426f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.845747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d3f5d67-03d3-4ccb-9806-fbc102a426f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.846050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d3f5d67-03d3-4ccb-9806-fbc102a426f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.846353] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d3f5d67-03d3-4ccb-9806-fbc102a426f0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.964022] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.277146] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 155f8da9-bd0f-41ba-b11d-9ea39b0bca44: rpc.has_security_group_logging(os_id): False [ 583.299175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.299175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.299175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.299398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.299398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.300368] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.300368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.300368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.300368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.300368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.300368] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.300677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.301412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.305021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.305021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.305021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.305021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.305021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.305021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.305021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.305021] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 is going to be created. [ 583.338895] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1b3e4790-aced-4ab8-955b-ee34c7f87fbf None None] Enqueued Resource ID: e225ba90-5236-4b8a-a8d4-abc6b5c30258 with Priority: HIGHEST for action port [ 583.339291] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e225ba90-5236-4b8a-a8d4-abc6b5c30258 with Priority: HIGHEST for action port [ 583.339628] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e225ba90-5236-4b8a-a8d4-abc6b5c30258 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.339802] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e225ba90-5236-4b8a-a8d4-abc6b5c30258" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.340718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e225ba90-5236-4b8a-a8d4-abc6b5c30258" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.340718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e225ba90-5236-4b8a-a8d4-abc6b5c30258" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.340718] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e225ba90-5236-4b8a-a8d4-abc6b5c30258',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.349042] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d3f5d67-03d3-4ccb-9806-fbc102a426f0 [ 583.349042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.349042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.349240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.349516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.349677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.349851] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d3f5d67-03d3-4ccb-9806-fbc102a426f0 already deleted. [ 583.349964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d3f5d67-03d3-4ccb-9806-fbc102a426f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.370848] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.371044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.371121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.371347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.371530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.384962] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 in Status: IN_PROGRESS for 2s [ 583.467292] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.467292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.467635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.467635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.467760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.467869] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be created. [ 583.505888] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.505888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.505888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.505888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.505888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.516113] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: UNINITIALIZED for 2s [ 583.842835] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e225ba90-5236-4b8a-a8d4-abc6b5c30258 [ 583.843137] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.843280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.843349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.843560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.843718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.843718] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e225ba90-5236-4b8a-a8d4-abc6b5c30258 already deleted. [ 583.843817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e225ba90-5236-4b8a-a8d4-abc6b5c30258" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.668028] env[65107]: INFO networking_nsxv3.common.synchronization [None req-96163a19-84ee-4cd7-8079-0dc261f5a727 None None] Enqueued Resource ID: 547bfb6f-bf3c-47f6-a78c-b66709f14a3f with Priority: HIGHEST for action port [ 584.668464] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547bfb6f-bf3c-47f6-a78c-b66709f14a3f with Priority: HIGHEST for action port [ 584.672021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-547bfb6f-bf3c-47f6-a78c-b66709f14a3f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.672021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-547bfb6f-bf3c-47f6-a78c-b66709f14a3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.672021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-547bfb6f-bf3c-47f6-a78c-b66709f14a3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.672021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-547bfb6f-bf3c-47f6-a78c-b66709f14a3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.672021] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('547bfb6f-bf3c-47f6-a78c-b66709f14a3f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.173038] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 547bfb6f-bf3c-47f6-a78c-b66709f14a3f [ 585.173038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.173038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.173038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.173038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.173038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.173038] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:547bfb6f-bf3c-47f6-a78c-b66709f14a3f already deleted. [ 585.173038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-547bfb6f-bf3c-47f6-a78c-b66709f14a3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.398227] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 in Status: SUCCESS [ 585.398362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.527266] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.527266] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.527266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.527266] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.029996] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.029996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.030321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.030321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.030479] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.030586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.030639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.031369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.031369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.031369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.031369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.031369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.031369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.031766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.031766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.031766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.031861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.031955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.032051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.032114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.032415] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.536785] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57ccc978-a1f0-4c03-8296-5acfbdaf68e4: rpc.has_security_group_logging(os_id): False [ 586.558451] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.558451] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.558451] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.558451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.558960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.558960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.558960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.558960] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.559107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.559236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.561952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.561952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.561952] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be created. [ 586.595041] env[65107]: INFO networking_nsxv3.common.synchronization [req-d7d02951-ccd3-4cd6-8c75-4b7f1e7f45d1 req-a68ec378-4ef9-4c2b-bce8-eecbfb847879 tempest-DeleteServersAdminTestJSON-30165657 tempest-DeleteServersAdminTestJSON-30165657-project-member] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 586.595041] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 586.596202] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.596202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.596202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.596202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.596202] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.596202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.596202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.596543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.596543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.596543] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.624704] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.626561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.626561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.626561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.626561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.641058] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 587.056312] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.056312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.056312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.056312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.056312] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.056312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.056312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.056312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.056312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.056312] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.056312] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.056312] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.056312] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.057122] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.057122] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.057122] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.079026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.079026] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.079026] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.079026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.079026] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-9e43597f-aaed-471a-ab8a-6a60a56effbd taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.079026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.079026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.079584] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.079815] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e43597f-aaed-471a-ab8a-6a60a56effbd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.101888] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.101888] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.101888] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd already deleted. [ 587.101888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.335097] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4924ed6e-a7a3-48b6-af20-1cfa02ff09bf None None] Enqueued Resource ID: 8d78e6d0-2a43-428b-b744-629f8babbf08 with Priority: HIGHEST for action port [ 587.335656] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d78e6d0-2a43-428b-b744-629f8babbf08 with Priority: HIGHEST for action port [ 587.335968] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d78e6d0-2a43-428b-b744-629f8babbf08 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.336104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d78e6d0-2a43-428b-b744-629f8babbf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.336174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d78e6d0-2a43-428b-b744-629f8babbf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.336451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d78e6d0-2a43-428b-b744-629f8babbf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.336554] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d78e6d0-2a43-428b-b744-629f8babbf08',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.583954] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.583954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.583954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.584168] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.584296] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.584438] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 9e43597f-aaed-471a-ab8a-6a60a56effbd not found, creating... [ 587.584725] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.584926] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.585056] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.585265] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.585396] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.585677] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.586380] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.586380] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.586380] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.586380] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.586572] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 9e43597f-aaed-471a-ab8a-6a60a56effbd is going to be created. [ 587.608100] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.608100] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.608852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.608852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.608852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.609054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.838596] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d78e6d0-2a43-428b-b744-629f8babbf08 [ 587.838878] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.839057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.839185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.839325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.839415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.839512] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d78e6d0-2a43-428b-b744-629f8babbf08 already deleted. [ 587.839592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d78e6d0-2a43-428b-b744-629f8babbf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.090316] env[65107]: INFO networking_nsxv3.common.synchronization [None req-cec5d295-c497-4ee7-b078-a58b3599b2af None None] Enqueued Resource ID: a10fa684-020d-41a0-a2d6-845c759e09a0 with Priority: HIGHEST for action port [ 588.090777] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10fa684-020d-41a0-a2d6-845c759e09a0 with Priority: HIGHEST for action port [ 588.091060] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a10fa684-020d-41a0-a2d6-845c759e09a0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.091185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a10fa684-020d-41a0-a2d6-845c759e09a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.091253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a10fa684-020d-41a0-a2d6-845c759e09a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.091516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a10fa684-020d-41a0-a2d6-845c759e09a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.091770] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a10fa684-020d-41a0-a2d6-845c759e09a0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.297350] env[65107]: INFO networking_nsxv3.common.synchronization [req-d7d02951-ccd3-4cd6-8c75-4b7f1e7f45d1 req-68e00ee4-7656-4348-8f56-aaa7ba40deb9 service nova] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_rules [ 588.297350] env[65107]: INFO networking_nsxv3.common.synchronization [req-d7d02951-ccd3-4cd6-8c75-4b7f1e7f45d1 req-68e00ee4-7656-4348-8f56-aaa7ba40deb9 service nova] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 588.297350] env[65107]: INFO networking_nsxv3.common.synchronization [req-d7d02951-ccd3-4cd6-8c75-4b7f1e7f45d1 req-68e00ee4-7656-4348-8f56-aaa7ba40deb9 service nova] Enqueued Resource ID: 9e43597f-aaed-471a-ab8a-6a60a56effbd with Priority: HIGHEST for action port [ 588.297350] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_rules [ 588.297350] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 588.297350] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e43597f-aaed-471a-ab8a-6a60a56effbd with Priority: HIGHEST for action port [ 588.297795] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.298058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.298206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.298533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.298710] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.299810] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.300077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.301097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.301097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.301097] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.301097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.301097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.301097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.301097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.301769] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.302932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e43597f-aaed-471a-ab8a-6a60a56effbd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.302932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.302932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.302932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.303198] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e43597f-aaed-471a-ab8a-6a60a56effbd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.595212] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a10fa684-020d-41a0-a2d6-845c759e09a0 [ 588.595212] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.595212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.596468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.596468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.596468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.596468] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a10fa684-020d-41a0-a2d6-845c759e09a0 already deleted. [ 588.596468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a10fa684-020d-41a0-a2d6-845c759e09a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.653715] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 588.653932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.807411] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.807546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.807831] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.808716] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e43597f-aaed-471a-ab8a-6a60a56effbd with status ACTIVE [ 588.808912] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.809042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.809109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.809315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.809406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.809585] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.809683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.809747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.809901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.809968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.810980] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.811216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.811331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.812580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.812580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.812580] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e43597f-aaed-471a-ab8a-6a60a56effbd is going to be updated. [ 588.836180] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.836469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.836637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.836928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.837172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.837450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e43597f-aaed-471a-ab8a-6a60a56effbd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.846022] env[65107]: INFO networking_nsxv3.common.synchronization [req-9325e3a6-c4fd-4630-86ac-759937ec0631 req-c6ee1c99-955f-40d4-a93f-e7a88e972b50 tempest-ImagesOneServerTestJSON-996413779 tempest-ImagesOneServerTestJSON-996413779-project-member] Enqueued Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_members [ 588.846022] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_members [ 588.846022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.846022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.846022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.846022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.846022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.846022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.847856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.847856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.850014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.850014] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.280699] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-995 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.280699] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-995" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.280699] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-995" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.280699] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-995" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.282619] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.282833] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.282943] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.283238] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.283386] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.283587] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.284422] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.284422] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.284422] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.284422] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.284422] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.284422] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.303973] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.304165] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.304217] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.304766] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-995" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.305493] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-fe750bd5-4350-4860-8a25-1ea44607ce8f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.305628] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.305628] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.306537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.306860] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe750bd5-4350-4860-8a25-1ea44607ce8f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.314304] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.351277] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.351756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.351756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.352168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.352240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.352463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.352566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.352833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.352833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.352833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.352992] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 already deleted. [ 589.352992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.810590] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.811111] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.811111] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.811276] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.811353] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.811505] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port fe750bd5-4350-4860-8a25-1ea44607ce8f not found, creating... [ 589.811770] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.811926] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.812048] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.812268] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.812399] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.812674] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.812826] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.812935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.813152] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.813280] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.813414] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: fe750bd5-4350-4860-8a25-1ea44607ce8f is going to be created. [ 589.816181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.816331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.816377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.816502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.816582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.816672] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be created. [ 589.836541] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.836755] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.836876] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.837169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.837390] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.837608] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.852800] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.853026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.853026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.853241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.853404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.866389] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: UNINITIALIZED for 2s [ 589.983362] env[65107]: INFO networking_nsxv3.common.synchronization [None req-ba46f265-2162-4606-a95e-39d5454ca692 None None] Enqueued Resource ID: ddeae9ce-4411-4c4e-8c40-7e53624370e7 with Priority: HIGHEST for action port [ 589.984427] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddeae9ce-4411-4c4e-8c40-7e53624370e7 with Priority: HIGHEST for action port [ 589.984765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddeae9ce-4411-4c4e-8c40-7e53624370e7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.984899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddeae9ce-4411-4c4e-8c40-7e53624370e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.984982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddeae9ce-4411-4c4e-8c40-7e53624370e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.986198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddeae9ce-4411-4c4e-8c40-7e53624370e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.986319] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddeae9ce-4411-4c4e-8c40-7e53624370e7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.488736] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddeae9ce-4411-4c4e-8c40-7e53624370e7 [ 590.489027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.489210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.490199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.490454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.490554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.490661] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddeae9ce-4411-4c4e-8c40-7e53624370e7 already deleted. [ 590.490749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddeae9ce-4411-4c4e-8c40-7e53624370e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.647412] env[65107]: INFO networking_nsxv3.common.synchronization [req-9325e3a6-c4fd-4630-86ac-759937ec0631 req-ec2027ca-47ea-4324-8e20-8caf5f5fc085 service nova] Enqueued Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_rules [ 590.647666] env[65107]: INFO networking_nsxv3.common.synchronization [req-9325e3a6-c4fd-4630-86ac-759937ec0631 req-ec2027ca-47ea-4324-8e20-8caf5f5fc085 service nova] Enqueued Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_members [ 590.647826] env[65107]: INFO networking_nsxv3.common.synchronization [req-9325e3a6-c4fd-4630-86ac-759937ec0631 req-ec2027ca-47ea-4324-8e20-8caf5f5fc085 service nova] Enqueued Resource ID: fe750bd5-4350-4860-8a25-1ea44607ce8f with Priority: HIGHEST for action port [ 590.648645] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_rules [ 590.648645] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_members [ 590.648645] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe750bd5-4350-4860-8a25-1ea44607ce8f with Priority: HIGHEST for action port [ 590.649763] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.649763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.649763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.649763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.649763] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.650589] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.650589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.650589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.650833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.650833] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.650921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.650977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.651126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.651258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.651329] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.652082] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe750bd5-4350-4860-8a25-1ea44607ce8f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.652316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.652316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.652607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.652607] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe750bd5-4350-4860-8a25-1ea44607ce8f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.092868] env[65107]: INFO networking_nsxv3.common.synchronization [req-bd0e8b6f-ee4d-48c4-8f96-13e6c8ce693f req-74b688c3-ef7f-4378-a108-9d91b5312c2d tempest-ServersAdminNegativeTestJSON-1455848825 tempest-ServersAdminNegativeTestJSON-1455848825-project-member] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 591.093415] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 591.093710] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.093831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.093898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.094722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.097220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.097220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.097220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.097220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.097220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.097220] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.156192] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.156192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.156438] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.159173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe750bd5-4350-4860-8a25-1ea44607ce8f with status ACTIVE [ 591.159173] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.159173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.159173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.159173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.159173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.159173] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.159173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.159173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.159990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.159990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.159990] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.159990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.159990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.159990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.160230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.160230] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe750bd5-4350-4860-8a25-1ea44607ce8f is going to be updated. [ 591.185293] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.185463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.185596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.185697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.186017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.186017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe750bd5-4350-4860-8a25-1ea44607ce8f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.484409] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.484626] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.484741] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.485070] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.485366] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.485524] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.485638] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.485859] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.486009] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.486757] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.486881] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.487014] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.487122] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.487230] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.487334] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.487455] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.506342] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.506638] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.507443] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.507443] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.507443] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-3a484df0-6d66-4485-849e-251784a45305 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.507597] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.507636] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.508231] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.508231] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a484df0-6d66-4485-849e-251784a45305',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.600481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.600481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.600481] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 already deleted. [ 591.600481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.665426] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.877973] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: SUCCESS [ 591.878198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.878388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.878930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.879091] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.879225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.879225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.879385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.879465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.879549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.879640] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.011493] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.011795] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.011795] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.012081] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.012273] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.012428] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 3a484df0-6d66-4485-849e-251784a45305 not found, creating... [ 592.012622] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.012844] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.012972] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.013203] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.013334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.013652] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.013909] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.013909] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.014124] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.014371] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.014430] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 3a484df0-6d66-4485-849e-251784a45305 is going to be created. [ 592.039295] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.039295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.039295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.039295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.039295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.039295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.168166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.168344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.168412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.168661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.168738] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.168937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 is going to be created. [ 592.199535] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.199813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.199813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.199954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.200124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.208950] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 in Status: UNINITIALIZED for 2s [ 592.382952] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.382952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.383445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.383445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.383445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.383619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.383619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.383682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.384126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.384126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.384126] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.384126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.384126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.384391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.384479] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.384544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.384602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.384778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.385593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.385593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.385593] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.804124] env[65107]: INFO networking_nsxv3.common.synchronization [req-bd0e8b6f-ee4d-48c4-8f96-13e6c8ce693f req-31261d8a-6753-4b44-b821-518f97107aa3 service nova] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_rules [ 592.804424] env[65107]: INFO networking_nsxv3.common.synchronization [req-bd0e8b6f-ee4d-48c4-8f96-13e6c8ce693f req-31261d8a-6753-4b44-b821-518f97107aa3 service nova] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 592.804424] env[65107]: INFO networking_nsxv3.common.synchronization [req-bd0e8b6f-ee4d-48c4-8f96-13e6c8ce693f req-31261d8a-6753-4b44-b821-518f97107aa3 service nova] Enqueued Resource ID: 3a484df0-6d66-4485-849e-251784a45305 with Priority: HIGHEST for action port [ 592.805102] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_rules [ 592.805173] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 592.805250] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a484df0-6d66-4485-849e-251784a45305 with Priority: HIGHEST for action port [ 592.805574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.805722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.805824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.806075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.806169] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.807494] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.808723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.808803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.808987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.809172] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.809305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.809370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.809525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.809615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.809725] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.811779] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a484df0-6d66-4485-849e-251784a45305 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.811779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.811779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.811779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.811779] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a484df0-6d66-4485-849e-251784a45305',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.888624] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 001132af-7c6a-44dd-97d6-1576257d23bd: rpc.has_security_group_logging(os_id): False [ 592.914191] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.915095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.915095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.915310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.915403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.915638] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.915764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.915830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.915978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.916066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.916265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.916350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.916411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.916543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.916619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.916794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.916964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.916964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.917388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.917540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.917583] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be created. [ 592.986843] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.987090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.987172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.987389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.987576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.002600] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: IN_PROGRESS for 2s [ 593.312736] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.312827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.314178] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.315179] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a484df0-6d66-4485-849e-251784a45305 with status ACTIVE [ 593.315383] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.315506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.315578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.315785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.315874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.316070] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.316163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.316229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.316382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.316458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.316636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.316724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.316850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.316957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.316988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.317605] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a484df0-6d66-4485-849e-251784a45305 is going to be updated. [ 593.355927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.355927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.355927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.355927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.355927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.355927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a484df0-6d66-4485-849e-251784a45305" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.466729] env[65107]: INFO networking_nsxv3.common.synchronization [req-a65e61a3-cec8-43f0-a736-64d8f8f23ab4 req-3501e7cd-36c4-4b60-b8a9-4fae0f5f66d3 tempest-ServerExternalEventsTest-1143963566 tempest-ServerExternalEventsTest-1143963566-project-member] Enqueued Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_members [ 593.466729] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_members [ 593.467316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2882833-81aa-4338-b54e-9f9cd3047983 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.467316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.467316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.467517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.467640] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.467765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.467829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.468021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.468322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.468322] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.767917] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.767917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.767917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.767917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.767917] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.767917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.767917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.767917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.767917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.767917] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.767917] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.767917] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.767917] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.768533] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.768533] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.768533] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.789539] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.789723] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.789974] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.790057] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.790395] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-e97972ed-b1d4-4026-969a-fd15f642416c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.790791] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.790791] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.791020] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.791143] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e97972ed-b1d4-4026-969a-fd15f642416c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.822279] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.970227] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.972215] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.972215] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2882833-81aa-4338-b54e-9f9cd3047983 already deleted. [ 593.972215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.221425] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 in Status: SUCCESS [ 594.221686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.221901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.222192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.222458] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.222639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.222794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.222931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.223086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.223178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.223349] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.294150] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.294525] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.294718] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.295149] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.295403] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.295616] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port e97972ed-b1d4-4026-969a-fd15f642416c not found, creating... [ 594.295967] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.296185] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.296337] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.296645] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.296988] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.297358] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.297562] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.297683] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.297992] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.298155] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.298285] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: e97972ed-b1d4-4026-969a-fd15f642416c is going to be created. [ 594.320250] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.320436] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.320559] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.320856] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.321104] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.321419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.325187] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.325328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.325431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.325664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.325881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.326024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be created. [ 594.357651] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.358392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.358392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.358392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.358392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.378874] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: UNINITIALIZED for 2s [ 594.725629] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.725812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.725875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.726155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.726336] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.726442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.726503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.726657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.726778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.726824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.726966] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.727073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.727139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.727738] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.727738] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.727738] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.727738] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.728022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.728022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.728022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.728127] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.015608] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: SUCCESS [ 595.015982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.057676] env[65107]: INFO networking_nsxv3.common.synchronization [req-a65e61a3-cec8-43f0-a736-64d8f8f23ab4 req-8c86545b-700b-4702-8ab7-06c437052e10 service nova] Enqueued Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_rules [ 595.057676] env[65107]: INFO networking_nsxv3.common.synchronization [req-a65e61a3-cec8-43f0-a736-64d8f8f23ab4 req-8c86545b-700b-4702-8ab7-06c437052e10 service nova] Enqueued Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_members [ 595.057676] env[65107]: INFO networking_nsxv3.common.synchronization [req-a65e61a3-cec8-43f0-a736-64d8f8f23ab4 req-8c86545b-700b-4702-8ab7-06c437052e10 service nova] Enqueued Resource ID: e97972ed-b1d4-4026-969a-fd15f642416c with Priority: HIGHEST for action port [ 595.057676] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_rules [ 595.057676] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_members [ 595.057676] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97972ed-b1d4-4026-969a-fd15f642416c with Priority: HIGHEST for action port [ 595.057676] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2882833-81aa-4338-b54e-9f9cd3047983 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.057676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.060096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.060096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.060096] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.060096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2882833-81aa-4338-b54e-9f9cd3047983 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.060428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.060428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.060428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.061463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.061463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.061463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.061463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.061463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.061463] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.062220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e97972ed-b1d4-4026-969a-fd15f642416c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.062326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.062855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.062855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.062855] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e97972ed-b1d4-4026-969a-fd15f642416c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.230422] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8764e835-f7cd-46d9-9326-fc9bab923c64: rpc.has_security_group_logging(os_id): False [ 595.249727] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.249975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.250123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.251077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.251077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.251077] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.251288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.251288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.251480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.251620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.251918] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.252215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.252379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.253141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.254024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.254024] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.254024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.254024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.254225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.254293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.254440] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 is going to be created. [ 595.345126] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.345313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.345353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.345641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.345945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.361249] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 in Status: IN_PROGRESS for 2s [ 595.564078] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.566408] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2882833-81aa-4338-b54e-9f9cd3047983 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.566543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.566981] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e97972ed-b1d4-4026-969a-fd15f642416c with status ACTIVE [ 595.567349] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.567349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.567560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.567619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.568128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.568128] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.568128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.568128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.568307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.568307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.568498] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.568596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.568659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.568849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.568931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.569054] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e97972ed-b1d4-4026-969a-fd15f642416c is going to be updated. [ 595.598412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.598622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.598743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.598962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.599126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.599421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e97972ed-b1d4-4026-969a-fd15f642416c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.684904] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1edabdff-c9ce-4f06-8186-81b0251c4312 None None] Enqueued Resource ID: 845cd7f2-0cc5-402c-acff-d596defd3f60 with Priority: HIGHEST for action port [ 595.685824] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845cd7f2-0cc5-402c-acff-d596defd3f60 with Priority: HIGHEST for action port [ 595.686042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-845cd7f2-0cc5-402c-acff-d596defd3f60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.686193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-845cd7f2-0cc5-402c-acff-d596defd3f60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.686272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-845cd7f2-0cc5-402c-acff-d596defd3f60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.686497] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-845cd7f2-0cc5-402c-acff-d596defd3f60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.686649] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('845cd7f2-0cc5-402c-acff-d596defd3f60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.067470] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.188654] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 845cd7f2-0cc5-402c-acff-d596defd3f60 [ 596.188963] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.189127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.189207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.189440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.189565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.189642] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:845cd7f2-0cc5-402c-acff-d596defd3f60 already deleted. [ 596.189733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-845cd7f2-0cc5-402c-acff-d596defd3f60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.392388] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: SUCCESS [ 596.392554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.392728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.392947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.393158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.393309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.393384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.393521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.393600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.393684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.393773] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.570940] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.571146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.571213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.571532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.571532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.571664] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2882833-81aa-4338-b54e-9f9cd3047983 is going to be created. [ 596.599259] env[65107]: INFO networking_nsxv3.common.synchronization [req-1b8aeeee-0122-4846-9a47-508972f45bf5 req-964659ee-7b6d-49fa-99bc-d30a993cea10 tempest-MigrationsAdminTest-1967309458 tempest-MigrationsAdminTest-1967309458-project-member] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 596.599364] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 596.599642] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.599767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.600350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.600350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.600350] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.600350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.600573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.600573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.600640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.601955] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.606194] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.606286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.606328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.606530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.606690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.622088] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2882833-81aa-4338-b54e-9f9cd3047983 in Status: UNINITIALIZED for 2s [ 596.897471] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.897471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.897471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.897471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.897912] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.897912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.897912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.898056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.898086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.898494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.898494] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.898494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.898659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.898690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.898903] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.899043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.899112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.899674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.899674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.899674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.899674] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.091460] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.091460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.091460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.091460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.091460] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.091460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.091460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.092462] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.092766] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.093130] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.093385] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.093605] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.093826] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.094067] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.094272] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.094552] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.110490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.110490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.110490] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4197bdde-e214-41a5-8235-df774396919e already deleted. [ 597.110490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.119100] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.119100] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.119100] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.119100] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.119100] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-3a7b222a-e1be-4fea-ae62-c09396f086c2 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.119100] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.119408] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.119455] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.119594] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a7b222a-e1be-4fea-ae62-c09396f086c2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.380503] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 in Status: SUCCESS [ 597.380779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.402448] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 562b8388-027e-4f71-8ef8-2da4162f2318: rpc.has_security_group_logging(os_id): False [ 597.424457] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.424631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.424711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.425091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.425257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.425516] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.425678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.425678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.425846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.425906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.426163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.426310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.426361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.426577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.426577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.426714] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.426810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.426866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.427036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.427102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.427187] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be created. [ 597.500804] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.500804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.500804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.500804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.500804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.516216] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: IN_PROGRESS for 2s [ 597.623173] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.623173] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.623173] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.623173] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.623173] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.623173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 3a7b222a-e1be-4fea-ae62-c09396f086c2 not found, creating... [ 597.623402] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.623553] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.623664] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.625248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.625248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.625248] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.625248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.625248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.625248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.625248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.625248] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 3a7b222a-e1be-4fea-ae62-c09396f086c2 is going to be created. [ 597.661715] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.661981] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.662058] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.662343] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.662563] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.662799] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.292146] env[65107]: INFO networking_nsxv3.common.synchronization [None req-fa0e8d71-0b31-4a45-bdae-4d6ef3560548 None None] Enqueued Resource ID: de0f1708-f177-4195-8378-18907fe4e4a0 with Priority: HIGHEST for action port [ 598.293916] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de0f1708-f177-4195-8378-18907fe4e4a0 with Priority: HIGHEST for action port [ 598.294820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-de0f1708-f177-4195-8378-18907fe4e4a0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.294820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de0f1708-f177-4195-8378-18907fe4e4a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.295364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de0f1708-f177-4195-8378-18907fe4e4a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.295439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de0f1708-f177-4195-8378-18907fe4e4a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.295494] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de0f1708-f177-4195-8378-18907fe4e4a0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.453715] env[65107]: INFO networking_nsxv3.common.synchronization [req-1b8aeeee-0122-4846-9a47-508972f45bf5 req-a09c7861-2a64-482c-a846-3b5f654cbac4 service nova] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_rules [ 598.453899] env[65107]: INFO networking_nsxv3.common.synchronization [req-1b8aeeee-0122-4846-9a47-508972f45bf5 req-a09c7861-2a64-482c-a846-3b5f654cbac4 service nova] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 598.454073] env[65107]: INFO networking_nsxv3.common.synchronization [req-1b8aeeee-0122-4846-9a47-508972f45bf5 req-a09c7861-2a64-482c-a846-3b5f654cbac4 service nova] Enqueued Resource ID: 3a7b222a-e1be-4fea-ae62-c09396f086c2 with Priority: HIGHEST for action port [ 598.454660] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_rules [ 598.454742] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 598.454851] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7b222a-e1be-4fea-ae62-c09396f086c2 with Priority: HIGHEST for action port [ 598.455483] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.455674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.455792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.456269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.456411] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.457551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.457762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.457862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.458120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.458525] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.458525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.458525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.458845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.459108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.459328] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.460922] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a7b222a-e1be-4fea-ae62-c09396f086c2 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.462496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.462496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.462496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.462496] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a7b222a-e1be-4fea-ae62-c09396f086c2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.633693] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2882833-81aa-4338-b54e-9f9cd3047983 in Status: SUCCESS [ 598.633693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.633693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.633693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.633693] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.633693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.635037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.635037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.635037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.635037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.635037] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.799076] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de0f1708-f177-4195-8378-18907fe4e4a0 [ 598.799280] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.800777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.800777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.800777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.800777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.800777] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de0f1708-f177-4195-8378-18907fe4e4a0 already deleted. [ 598.800777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de0f1708-f177-4195-8378-18907fe4e4a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.964536] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.965643] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.965643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.966747] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a7b222a-e1be-4fea-ae62-c09396f086c2 with status ACTIVE [ 598.966849] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.966966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.967046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.967284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.967327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.968042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.968042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.968042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.968042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.968042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.968343] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.968343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.968343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.968459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.968459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.968527] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a7b222a-e1be-4fea-ae62-c09396f086c2 is going to be updated. [ 598.989882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.989882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.989882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.990117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.990161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.990317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a7b222a-e1be-4fea-ae62-c09396f086c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.138956] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2882833-81aa-4338-b54e-9f9cd3047983 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.139139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.139207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.139420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.139591] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.139730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.139860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.139929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.140023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.140080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.140223] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2882833-81aa-4338-b54e-9f9cd3047983 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.140332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.140372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.140503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.140641] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.141072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.141072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.141072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.141072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.141072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.141382] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.271446] env[65107]: INFO networking_nsxv3.common.synchronization [None req-c86f2a2b-a710-436f-9914-1bdbb5a40b10 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 599.272010] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 599.272431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.272586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.272748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.272998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.273153] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.466423] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.531948] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: SUCCESS [ 599.532311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.643961] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2882833-81aa-4338-b54e-9f9cd3047983: rpc.has_security_group_logging(os_id): False [ 599.660262] env[65107]: INFO networking_nsxv3.common.synchronization [None req-49df58e2-15bf-47bb-a097-bb1fb05c75d4 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 599.661817] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 599.661817] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.661817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.665853] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.666047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.666136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.666329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.666413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.666601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.666698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.666753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.666894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.666964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.667168] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.667259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.667309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.668417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.668417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.668417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.668417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.668417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.668417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.668417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.668417] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2882833-81aa-4338-b54e-9f9cd3047983 is going to be created. [ 599.745166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.745460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.745657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.745799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.746009] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.761533] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2882833-81aa-4338-b54e-9f9cd3047983 in Status: IN_PROGRESS for 2s [ 599.808241] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.808471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.808543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.808788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.808956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.809032] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 already deleted. [ 599.809080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.809257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.809386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.809466] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.970035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.970035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.970035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.970035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.970035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.970610] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4197bdde-e214-41a5-8235-df774396919e is going to be created. [ 599.999024] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.999024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.999024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.999024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.999024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.009401] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: UNINITIALIZED for 2s [ 600.343292] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.344661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.344661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.344661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.344661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.344661] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 already deleted. [ 600.344661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.158527] env[65107]: INFO networking_nsxv3.common.synchronization [None req-933c00ff-0add-4891-b426-9f57f7945e14 None None] Enqueued Resource ID: ebaa28b9-0b24-42c3-8fa0-596ac58b05c7 with Priority: HIGHEST for action port [ 601.159639] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebaa28b9-0b24-42c3-8fa0-596ac58b05c7 with Priority: HIGHEST for action port [ 601.159639] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebaa28b9-0b24-42c3-8fa0-596ac58b05c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.159639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebaa28b9-0b24-42c3-8fa0-596ac58b05c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.159792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebaa28b9-0b24-42c3-8fa0-596ac58b05c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.159954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebaa28b9-0b24-42c3-8fa0-596ac58b05c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.160063] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebaa28b9-0b24-42c3-8fa0-596ac58b05c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.662598] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebaa28b9-0b24-42c3-8fa0-596ac58b05c7 [ 601.662838] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.662972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.663056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.663292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.663382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.663517] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebaa28b9-0b24-42c3-8fa0-596ac58b05c7 already deleted. [ 601.663553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebaa28b9-0b24-42c3-8fa0-596ac58b05c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.775794] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2882833-81aa-4338-b54e-9f9cd3047983 in Status: SUCCESS [ 601.777407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.022418] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: SUCCESS [ 602.022972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.023224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.023446] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.023644] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.023833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.023833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.024028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.024125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.024225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.024307] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.526738] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.527133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.527133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.527258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.527445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.527553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.527553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.527739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.527937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.528098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.528160] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.528258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.528321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.528458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.528803] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.528803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.528803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.528978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.528978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.529077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.529122] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.624922] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-cdc5233a-12eb-4b5a-a107-a21e236cea95 tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 602.625342] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 602.625641] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.625769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.625876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.626398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.626626] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.627125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.627199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.627396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.627448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.627545] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.844147] env[65107]: INFO networking_nsxv3.common.synchronization [None req-ea1edfe5-e182-4cfc-b2d1-232e7b7d769c None None] Enqueued Resource ID: b858c324-b2d1-472a-98d6-7f5938971431 with Priority: HIGHEST for action port [ 602.844696] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b858c324-b2d1-472a-98d6-7f5938971431 with Priority: HIGHEST for action port [ 602.845047] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b858c324-b2d1-472a-98d6-7f5938971431 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.845260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b858c324-b2d1-472a-98d6-7f5938971431" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.845260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b858c324-b2d1-472a-98d6-7f5938971431" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.845538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b858c324-b2d1-472a-98d6-7f5938971431" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.845622] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b858c324-b2d1-472a-98d6-7f5938971431',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.908311] env[65107]: INFO networking_nsxv3.common.synchronization [None req-5756754e-0703-40c9-8111-122e423f0649 tempest-ServersWithSpecificFlavorTestJSON-1770061733 tempest-ServersWithSpecificFlavorTestJSON-1770061733-project-member] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 602.909710] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 602.910610] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.910839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.910970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.911345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.912086] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.030877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4197bdde-e214-41a5-8235-df774396919e: rpc.has_security_group_logging(os_id): False [ 603.052146] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.052146] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.052146] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.052146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.052874] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.052874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.052874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.052874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.052874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.053258] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4197bdde-e214-41a5-8235-df774396919e is going to be created. [ 603.116360] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-758e700d-efc5-4b25-a3e4-53d3cc0bdd9e tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 603.117928] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.118071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.118185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.118419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.118604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.121541] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 603.121541] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.121541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.131148] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.131337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.131385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.131673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.131736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.131953] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.132076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.132141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.132355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.132458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.132548] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd already deleted. [ 603.132629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.133497] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: IN_PROGRESS for 2s [ 603.133616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.133776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.133967] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.134203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.134312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.134525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.134615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.134710] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.348197] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b858c324-b2d1-472a-98d6-7f5938971431 [ 603.348197] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.348197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.348197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.348455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.348455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.348751] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b858c324-b2d1-472a-98d6-7f5938971431 already deleted. [ 603.348751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b858c324-b2d1-472a-98d6-7f5938971431" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.435917] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.436285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.436285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.436595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.436703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.436803] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 already deleted. [ 603.436892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.449030] env[65107]: INFO networking_nsxv3.common.synchronization [None req-9f93365a-a94c-47ba-aae8-85c49109ae9d None None] Enqueued Resource ID: bc677fc2-c672-40ec-8114-0939c84ef807 with Priority: HIGHEST for action port [ 603.449644] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc677fc2-c672-40ec-8114-0939c84ef807 with Priority: HIGHEST for action port [ 603.449987] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc677fc2-c672-40ec-8114-0939c84ef807 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.450428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc677fc2-c672-40ec-8114-0939c84ef807" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.450499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc677fc2-c672-40ec-8114-0939c84ef807" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.450761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc677fc2-c672-40ec-8114-0939c84ef807" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.450853] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc677fc2-c672-40ec-8114-0939c84ef807',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.638867] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.638867] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.638867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.639445] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd already deleted. [ 603.639445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.923534] env[65107]: INFO networking_nsxv3.common.synchronization [None req-b654e2ec-acd8-433b-8307-58a465fba174 tempest-ServersWithSpecificFlavorTestJSON-1770061733 tempest-ServersWithSpecificFlavorTestJSON-1770061733-project-member] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 603.924375] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 603.924375] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.924533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.924533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.924651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.925112] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.954663] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc677fc2-c672-40ec-8114-0939c84ef807 [ 603.954663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.954663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.954663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.954663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.954663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.954663] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc677fc2-c672-40ec-8114-0939c84ef807 already deleted. [ 603.954663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc677fc2-c672-40ec-8114-0939c84ef807" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.250435] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-b5fa4aac-090a-4083-a8e3-862d2ffa717f tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 604.250435] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 604.250435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.250435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.250435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.250435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.250435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.250435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.250435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.250435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.250435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.251642] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.451545] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.451545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.451545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.452110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.452110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.453209] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 already deleted. [ 604.453378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.569273] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e9daf34e-65b6-45ba-92b0-1d028851e860 None None] Enqueued Resource ID: 5d447ac3-7f46-468b-9ccf-44dd94c87c1e with Priority: HIGHEST for action port [ 604.569273] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d447ac3-7f46-468b-9ccf-44dd94c87c1e with Priority: HIGHEST for action port [ 604.569273] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d447ac3-7f46-468b-9ccf-44dd94c87c1e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.569456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d447ac3-7f46-468b-9ccf-44dd94c87c1e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.569576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d447ac3-7f46-468b-9ccf-44dd94c87c1e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.569829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d447ac3-7f46-468b-9ccf-44dd94c87c1e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.569983] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d447ac3-7f46-468b-9ccf-44dd94c87c1e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.759133] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.759133] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.759133] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd already deleted. [ 604.759133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.049854] env[65107]: INFO networking_nsxv3.common.synchronization [req-a1282939-3c27-4993-9419-ebbb75dec024 req-13b2a64d-9d12-4e11-acd3-a9958c5abb58 tempest-ServerAddressesNegativeTestJSON-1722856828 tempest-ServerAddressesNegativeTestJSON-1722856828-project-member] Enqueued Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_members [ 605.050520] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_members [ 605.050665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.050795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.050854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.051158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.051329] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.051400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.051466] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.051676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.051894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.052877] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.073155] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d447ac3-7f46-468b-9ccf-44dd94c87c1e [ 605.073413] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.073551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.073638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.073905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.073940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.074056] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d447ac3-7f46-468b-9ccf-44dd94c87c1e already deleted. [ 605.074188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d447ac3-7f46-468b-9ccf-44dd94c87c1e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.156166] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: SUCCESS [ 605.156166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.403464] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-466 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.403656] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.403772] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.404129] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.405053] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.405053] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.405053] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.405053] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.405053] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.405550] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.405747] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.405942] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.406152] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.408993] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.408993] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.408993] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.430298] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.430298] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.430298] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.430298] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.430298] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.430298] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.430667] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.430667] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.430821] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed6deba-f4d6-4bdf-9e10-f338d304fcfa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.556756] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.556756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.556756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.556756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.556756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.556756] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.557545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.557638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.557827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.557965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.558089] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae409816-e898-46fe-b06e-b955dd9008ef already deleted. [ 605.558177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.650903] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.651192] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-62" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.651434] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-62" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.651786] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-62" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.652429] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.652589] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.652701] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.652930] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.653095] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.653298] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.653412] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.653514] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.653614] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.653718] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.653816] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.653939] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.676566] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.676750] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.677020] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.677242] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-62" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.677580] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-a261e20f-a6e1-45e5-bb21-b55618b0ef28 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.677901] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.678051] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.678377] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.678542] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a261e20f-a6e1-45e5-bb21-b55618b0ef28',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.934145] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.934483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.934483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.934589] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.935283] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.935283] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 6ed6deba-f4d6-4bdf-9e10-f338d304fcfa not found, creating... [ 605.935283] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.935283] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.935509] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.935573] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.935710] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.936081] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.936237] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.936347] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.936543] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.936671] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.936804] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 6ed6deba-f4d6-4bdf-9e10-f338d304fcfa is going to be created. [ 605.942272] env[65107]: INFO networking_nsxv3.common.synchronization [None req-11b815d4-111f-43e7-8e01-583743037943 None None] Enqueued Resource ID: f139eeb9-0672-4dc4-840e-4791943a89e7 with Priority: HIGHEST for action port [ 605.942576] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f139eeb9-0672-4dc4-840e-4791943a89e7 with Priority: HIGHEST for action port [ 605.943228] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f139eeb9-0672-4dc4-840e-4791943a89e7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.943683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f139eeb9-0672-4dc4-840e-4791943a89e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.943683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f139eeb9-0672-4dc4-840e-4791943a89e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.943791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f139eeb9-0672-4dc4-840e-4791943a89e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.943862] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f139eeb9-0672-4dc4-840e-4791943a89e7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.957434] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.957641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.957757] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.958060] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.958291] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.958502] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.180647] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.180949] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.181111] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.181576] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.181685] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.181793] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port a261e20f-a6e1-45e5-bb21-b55618b0ef28 not found, creating... [ 606.182074] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.182232] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.182342] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.182911] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.182911] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.183047] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.183144] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.183200] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.183401] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.183528] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.183658] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: a261e20f-a6e1-45e5-bb21-b55618b0ef28 is going to be created. [ 606.205734] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.205987] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.206102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.206356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.206584] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.206783] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.447178] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f139eeb9-0672-4dc4-840e-4791943a89e7 [ 606.447546] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.447837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.447911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.448219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.448368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.448505] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f139eeb9-0672-4dc4-840e-4791943a89e7 already deleted. [ 606.448630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f139eeb9-0672-4dc4-840e-4791943a89e7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.619865] env[65107]: INFO networking_nsxv3.common.synchronization [None req-06786224-d9b5-4d9f-b783-e76a45a2d1aa None None] Enqueued Resource ID: c617507f-e196-4643-81eb-decee3f6262d with Priority: HIGHEST for action port [ 606.620445] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c617507f-e196-4643-81eb-decee3f6262d with Priority: HIGHEST for action port [ 606.620753] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c617507f-e196-4643-81eb-decee3f6262d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.620875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c617507f-e196-4643-81eb-decee3f6262d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.620941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c617507f-e196-4643-81eb-decee3f6262d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.621232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c617507f-e196-4643-81eb-decee3f6262d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.621318] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c617507f-e196-4643-81eb-decee3f6262d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.659681] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-8fd7cca3-88b3-41e8-bf46-e447a790cfa0 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 606.659861] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-8fd7cca3-88b3-41e8-bf46-e447a790cfa0 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 606.660032] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-8fd7cca3-88b3-41e8-bf46-e447a790cfa0 service nova] Enqueued Resource ID: 6ed6deba-f4d6-4bdf-9e10-f338d304fcfa with Priority: HIGHEST for action port [ 606.660457] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 606.660599] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 606.660697] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed6deba-f4d6-4bdf-9e10-f338d304fcfa with Priority: HIGHEST for action port [ 606.660963] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.661503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.661602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.662066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.662193] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.665558] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.665558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.665558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.665558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.665558] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.665558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.665558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.665558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.665558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.665558] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.667824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.667824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.667824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.667824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.667824] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed6deba-f4d6-4bdf-9e10-f338d304fcfa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.949607] env[65107]: INFO networking_nsxv3.common.synchronization [req-a1282939-3c27-4993-9419-ebbb75dec024 req-df94950d-401a-4b72-a4cf-d141164cec47 service nova] Enqueued Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_rules [ 606.950926] env[65107]: INFO networking_nsxv3.common.synchronization [req-a1282939-3c27-4993-9419-ebbb75dec024 req-df94950d-401a-4b72-a4cf-d141164cec47 service nova] Enqueued Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_members [ 606.951480] env[65107]: INFO networking_nsxv3.common.synchronization [req-a1282939-3c27-4993-9419-ebbb75dec024 req-df94950d-401a-4b72-a4cf-d141164cec47 service nova] Enqueued Resource ID: a261e20f-a6e1-45e5-bb21-b55618b0ef28 with Priority: HIGHEST for action port [ 606.952209] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_rules [ 606.955741] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_members [ 606.955741] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a261e20f-a6e1-45e5-bb21-b55618b0ef28 with Priority: HIGHEST for action port [ 606.955741] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.955741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.955741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.955741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.955741] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.955741] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.955741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.955741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.955741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.955741] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.956699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.956699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.956817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.957511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.957511] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.959682] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a261e20f-a6e1-45e5-bb21-b55618b0ef28 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.960122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.960351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.960482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.960842] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a261e20f-a6e1-45e5-bb21-b55618b0ef28',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.122924] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c617507f-e196-4643-81eb-decee3f6262d [ 607.124482] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.124482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.124482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.124482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.124482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.124482] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c617507f-e196-4643-81eb-decee3f6262d already deleted. [ 607.124482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c617507f-e196-4643-81eb-decee3f6262d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.169025] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ed6deba-f4d6-4bdf-9e10-f338d304fcfa with status ACTIVE [ 607.169307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.169450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.169520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.169770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.169908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.170158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.170303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.170406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.170608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.170722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.170955] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.171097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.171193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.171342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.171458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.171582] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ed6deba-f4d6-4bdf-9e10-f338d304fcfa is going to be updated. [ 607.173369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.173651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.173877] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.198228] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.198390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.198435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.198641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.198809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.198954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ed6deba-f4d6-4bdf-9e10-f338d304fcfa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.294381] env[65107]: INFO networking_nsxv3.common.synchronization [req-9e2e938b-9221-43fb-aff5-bb89469ea929 req-09e33ccc-6a38-4b18-bd30-8a8b87c01b6d tempest-DeleteServersAdminTestJSON-1584485032 tempest-DeleteServersAdminTestJSON-1584485032-project-admin] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 607.297859] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 607.297859] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.297859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.297859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.297859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.297859] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.297859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.297859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.297859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.297859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.297859] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.462886] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.465076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.465076] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.465076] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a261e20f-a6e1-45e5-bb21-b55618b0ef28 with status ACTIVE [ 607.465076] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.465076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.465076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.465076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.465602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.465602] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.465602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.465602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.465736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.465834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.466299] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.466299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.466299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.466462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.466462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.466566] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a261e20f-a6e1-45e5-bb21-b55618b0ef28 is going to be updated. [ 607.490659] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.491050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.491050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.491190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.491268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.491426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a261e20f-a6e1-45e5-bb21-b55618b0ef28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.569912] env[65107]: INFO networking_nsxv3.common.synchronization [req-4d65c81e-fd01-4da5-97f3-cff34083de45 req-93f6fb94-c5c6-4da8-9133-da1e0696fbad tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 607.571295] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 607.571686] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.572013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.572098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.572351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.572540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.572668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.572761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.573064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.573064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.573154] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.676697] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.798880] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.799103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.799189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.799395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.799492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.799688] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.799788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.799838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.799997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.800104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.800223] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be updated. [ 607.832708] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.832968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.832968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.833157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.833339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.842473] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: IN_PROGRESS for 2s [ 607.909288] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-884 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.909572] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-884" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.909766] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-884" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.910158] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-884" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.910454] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.910646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.910789] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.911046] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.911229] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.911460] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.911572] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.911678] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.911780] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.911886] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.912051] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.912345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.931678] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.931839] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.931978] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.932270] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-884" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.932624] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.932827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.932946] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.933278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.933439] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.969442] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.971518] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.971694] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.971835] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.972202] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.972482] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.972647] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.972767] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.972976] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.973128] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.973328] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.973428] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.973533] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.973634] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.973732] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.973829] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.973949] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.992937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.993126] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.993264] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.993438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.993741] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-c2612555-7306-4358-a885-84ba8985ecc9 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.993905] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.994030] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.994347] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.994483] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2612555-7306-4358-a885-84ba8985ecc9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.076907] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.077038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.077038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.077243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.077421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.077519] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.077617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.077680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.077852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.077927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.078034] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 already deleted. [ 608.078102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.179423] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.179588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.179631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.179852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.179942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.180050] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be created. [ 608.205535] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.205728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.205806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.205988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.206189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.215780] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: UNINITIALIZED for 2s [ 608.436616] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.436700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.436827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.437118] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.437262] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.437410] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa not found, creating... [ 608.437905] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.438091] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.438205] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.438422] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.438552] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.438871] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.439531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.439531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.439692] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.439820] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.439954] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa is going to be created. [ 608.442653] env[65107]: INFO networking_nsxv3.common.synchronization [None req-6228d07c-f3e6-40c2-9b2e-f08cc5e27a2d None None] Enqueued Resource ID: 14ffdd30-01f2-4a29-b338-f8545dde370a with Priority: HIGHEST for action port [ 608.443378] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdd30-01f2-4a29-b338-f8545dde370a with Priority: HIGHEST for action port [ 608.443983] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-14ffdd30-01f2-4a29-b338-f8545dde370a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.444078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14ffdd30-01f2-4a29-b338-f8545dde370a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.444121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14ffdd30-01f2-4a29-b338-f8545dde370a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.444319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14ffdd30-01f2-4a29-b338-f8545dde370a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.444396] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14ffdd30-01f2-4a29-b338-f8545dde370a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.463659] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.463913] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.463990] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.464264] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.464885] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.465134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.476272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.476444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.476444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.476599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.476681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.476773] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae409816-e898-46fe-b06e-b955dd9008ef is going to be created. [ 608.498613] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.498793] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.498842] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.499647] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.499647] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.499647] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port c2612555-7306-4358-a885-84ba8985ecc9 not found, creating... [ 608.499841] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.499841] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.499937] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.500481] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.500481] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.500591] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.500661] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.500769] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.500966] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.501104] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.501236] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: c2612555-7306-4358-a885-84ba8985ecc9 is going to be created. [ 608.502962] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.503087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.503158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.503303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.503446] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.514690] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae409816-e898-46fe-b06e-b955dd9008ef in Status: UNINITIALIZED for 2s [ 608.526098] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.526321] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.526435] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.526693] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.527252] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.527252] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.946709] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14ffdd30-01f2-4a29-b338-f8545dde370a [ 608.946947] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.947167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.947231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.947403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.947494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.947586] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14ffdd30-01f2-4a29-b338-f8545dde370a already deleted. [ 608.947665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14ffdd30-01f2-4a29-b338-f8545dde370a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.182989] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-f7cc6dc8-486a-47cc-89e4-29fd3a25a188 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 609.183334] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-f7cc6dc8-486a-47cc-89e4-29fd3a25a188 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 609.183334] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-f7cc6dc8-486a-47cc-89e4-29fd3a25a188 service nova] Enqueued Resource ID: b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa with Priority: HIGHEST for action port [ 609.184025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 609.184165] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 609.184271] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa with Priority: HIGHEST for action port [ 609.184558] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.184646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.184832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.185021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.185094] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.185194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.185258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.185451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.185532] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.213802] env[65107]: INFO networking_nsxv3.common.synchronization [req-4d65c81e-fd01-4da5-97f3-cff34083de45 req-f069230f-5b3a-434f-b44b-7cb00067b0e9 service nova] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 609.213993] env[65107]: INFO networking_nsxv3.common.synchronization [req-4d65c81e-fd01-4da5-97f3-cff34083de45 req-f069230f-5b3a-434f-b44b-7cb00067b0e9 service nova] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 609.214141] env[65107]: INFO networking_nsxv3.common.synchronization [req-4d65c81e-fd01-4da5-97f3-cff34083de45 req-f069230f-5b3a-434f-b44b-7cb00067b0e9 service nova] Enqueued Resource ID: c2612555-7306-4358-a885-84ba8985ecc9 with Priority: HIGHEST for action port [ 609.215095] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 609.215254] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 609.215383] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2612555-7306-4358-a885-84ba8985ecc9 with Priority: HIGHEST for action port [ 609.215665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.215812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.215863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.216203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.216203] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.217105] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.217276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.217354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.218485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.218485] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.218485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.218485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.218485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.218485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.218485] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.219402] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2612555-7306-4358-a885-84ba8985ecc9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.219402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.219402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.219585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.219585] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2612555-7306-4358-a885-84ba8985ecc9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.691432] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa with status ACTIVE [ 609.691432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.691432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.691432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.691432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.691432] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa is going to be updated. [ 609.717175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.717320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.717392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.717613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.717753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.717959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0eb660e-46fd-46ed-a9ea-dccf1e26a2aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.721829] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.721945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.722137] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.723056] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2612555-7306-4358-a885-84ba8985ecc9 with status ACTIVE [ 609.723185] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.723302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.723372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.723533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.723612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.723986] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.723986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.723986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.724135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.724165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.724319] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.724402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.724728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.724728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.727309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.730299] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2612555-7306-4358-a885-84ba8985ecc9 is going to be updated. [ 609.760222] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.760499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.760499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.760618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.760754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.761044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.854470] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: SUCCESS [ 609.854708] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd deletion is rescheduled due to dependency. [ 609.854846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.121577] env[65107]: INFO networking_nsxv3.common.synchronization [req-b68a225b-a36d-445d-9cc7-1e4f0f8b8b4b req-2f1d9d4a-1e12-4bd5-bfd3-47d4decb41eb tempest-ServerDiagnosticsTest-1900989293 tempest-ServerDiagnosticsTest-1900989293-project-member] Enqueued Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_members [ 610.122092] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_members [ 610.122400] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.122955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.126339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.126642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.126830] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.126941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.127011] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.127180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.127266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.127364] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.228319] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 610.228319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.228319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.230824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.230824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.230824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.230824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.230824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.230824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.230824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.230824] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.230824] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.231840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.231840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.231840] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.232072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.232072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.232133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.232248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.232297] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.491303] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-466 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.491445] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.491550] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.491815] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.492144] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.492316] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.492427] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.492628] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.492766] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.492963] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.493084] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.493184] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.493283] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.493382] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.493630] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.493784] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.515242] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.515440] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.515519] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.515685] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-466" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.516056] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-b1113ca9-226f-45e7-b7bd-b0ad7326026b taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.516234] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.516348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.516660] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.516790] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1113ca9-226f-45e7-b7bd-b0ad7326026b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.527460] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae409816-e898-46fe-b06e-b955dd9008ef in Status: SUCCESS [ 610.527595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.527754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.528032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.528221] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.528775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.528775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.528775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.528775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.528775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.528775] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.605841] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.606033] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.606165] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.606432] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.606659] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.606799] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.606908] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.607166] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.607316] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.607523] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.607627] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.607726] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.607851] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.607973] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.608100] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.608225] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.626276] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.626432] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.626586] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.626710] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.627013] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.627180] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.627290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.627616] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.627718] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.628930] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.629129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.629129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.629269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.629355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.629550] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.629649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.629957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.629957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.629957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.630105] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 already deleted. [ 610.630105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.734057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.734236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.734304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.734528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.734622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.734717] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be created. [ 610.736149] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.736253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.736419] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.759943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.760206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.760281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.760492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.760660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.774104] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: UNINITIALIZED for 2s [ 610.834846] env[65107]: INFO networking_nsxv3.common.synchronization [None req-5067bf03-bfd6-442d-b842-de83cc6dfe9f None None] Enqueued Resource ID: f9e272ec-f2de-456e-bd24-58244211371d with Priority: HIGHEST for action port [ 610.835331] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e272ec-f2de-456e-bd24-58244211371d with Priority: HIGHEST for action port [ 610.836048] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9e272ec-f2de-456e-bd24-58244211371d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.836209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9e272ec-f2de-456e-bd24-58244211371d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.836283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9e272ec-f2de-456e-bd24-58244211371d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.836565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9e272ec-f2de-456e-bd24-58244211371d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.836653] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9e272ec-f2de-456e-bd24-58244211371d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.021213] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.021503] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.021603] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.021836] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.021978] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.022146] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port b1113ca9-226f-45e7-b7bd-b0ad7326026b not found, creating... [ 611.022919] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.022919] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.022919] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.022919] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.023358] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.023358] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.023478] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.023525] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.023727] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.023852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.024136] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: b1113ca9-226f-45e7-b7bd-b0ad7326026b is going to be created. [ 611.030902] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.031084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.031154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.031329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.031486] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.031596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.031653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.031778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.031863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.031950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.032439] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.032439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.032439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.032439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.032687] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.032687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.032687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.032804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.032895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.032988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.033104] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.131742] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.132069] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.132136] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.132429] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.132539] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.132657] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 not found, creating... [ 611.132916] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.133083] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.133195] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.133407] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.133537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.133807] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.133953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.134076] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.134295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.134423] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.134554] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 is going to be created. [ 611.146718] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.146969] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.147073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.147366] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.147552] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.147771] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.167185] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.170010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.170010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.170010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.170010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.170010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.239373] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.339162] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9e272ec-f2de-456e-bd24-58244211371d [ 611.339162] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.339162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.339477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.339477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.339548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.339650] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9e272ec-f2de-456e-bd24-58244211371d already deleted. [ 611.339730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9e272ec-f2de-456e-bd24-58244211371d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.534895] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae409816-e898-46fe-b06e-b955dd9008ef: rpc.has_security_group_logging(os_id): False [ 611.552543] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.552694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.552768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.552974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.553110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.553304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.553406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.553475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.553632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.553712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.553906] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.554250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.554250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.554250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.554250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.554445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.554540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.554601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.554747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.554843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.554905] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae409816-e898-46fe-b06e-b955dd9008ef is going to be created. [ 611.612550] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.612701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.612776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.612979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.613186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.624776] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae409816-e898-46fe-b06e-b955dd9008ef in Status: IN_PROGRESS for 2s [ 611.743693] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.743868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.743994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.744160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.744242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.744518] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 611.766150] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-d2d4c20f-e4ce-4810-a866-4de78c272376 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 611.766446] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-d2d4c20f-e4ce-4810-a866-4de78c272376 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 611.766541] env[65107]: INFO networking_nsxv3.common.synchronization [req-e47810d6-de08-453f-ac58-68c6871904f1 req-d2d4c20f-e4ce-4810-a866-4de78c272376 service nova] Enqueued Resource ID: b1113ca9-226f-45e7-b7bd-b0ad7326026b with Priority: HIGHEST for action port [ 611.768294] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 611.768378] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 611.768511] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1113ca9-226f-45e7-b7bd-b0ad7326026b with Priority: HIGHEST for action port [ 611.768778] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.768983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.769229] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.769326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.769834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1113ca9-226f-45e7-b7bd-b0ad7326026b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.770024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.770024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.770292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.770386] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1113ca9-226f-45e7-b7bd-b0ad7326026b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.802329] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.802478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.802556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.802777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.802919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.813815] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 611.886979] env[65107]: INFO networking_nsxv3.common.synchronization [req-b68a225b-a36d-445d-9cc7-1e4f0f8b8b4b req-e0724bff-4f49-4260-aff7-651341abd8af service nova] Enqueued Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_rules [ 611.887163] env[65107]: INFO networking_nsxv3.common.synchronization [req-b68a225b-a36d-445d-9cc7-1e4f0f8b8b4b req-e0724bff-4f49-4260-aff7-651341abd8af service nova] Enqueued Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_members [ 611.887291] env[65107]: INFO networking_nsxv3.common.synchronization [req-b68a225b-a36d-445d-9cc7-1e4f0f8b8b4b req-e0724bff-4f49-4260-aff7-651341abd8af service nova] Enqueued Resource ID: c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 with Priority: HIGHEST for action port [ 611.889027] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_rules [ 611.889027] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_members [ 611.889027] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 with Priority: HIGHEST for action port [ 611.890381] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.890565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.890608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.890935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.891404] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.892606] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.892606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.892606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.892892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.892892] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.892892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.893018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.896221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.896221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.896221] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.896221] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.896221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.896221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.896221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.896221] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.275439] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1113ca9-226f-45e7-b7bd-b0ad7326026b with status ACTIVE [ 612.276010] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.276127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.276181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.276396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.276493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.276676] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.276774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.276834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.276989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.277077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.278416] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.278910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.278910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.278910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.279114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.279157] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1113ca9-226f-45e7-b7bd-b0ad7326026b is going to be updated. [ 612.312339] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.312504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.312553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.312763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.312896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.313072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1113ca9-226f-45e7-b7bd-b0ad7326026b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.397872] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.398320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.398320] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 with status ACTIVE [ 612.399280] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.403131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.403131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.403131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.403131] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0 is going to be updated. [ 612.403131] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.436322] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.437569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.437569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.437569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.437569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.437569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3dfa4aa-ffd0-4e1a-a919-ea9d90eb44a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.790091] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 612.790427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.790636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.791414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.791414] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.791414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.791414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.791414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.791724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.791724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.791724] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.906968] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.298073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.299087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.299087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.299087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.299087] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.299087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.299087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.299087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.299505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.299505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.299505] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.299505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.299505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.299766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.299766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.299890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.299890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.300157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.300157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.300157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.300647] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.412034] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.412034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.412034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.412034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.412034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.412034] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 is going to be created. [ 613.439114] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.439114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.439114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.441079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.441278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.452301] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 in Status: UNINITIALIZED for 2s [ 613.638670] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae409816-e898-46fe-b06e-b955dd9008ef in Status: SUCCESS [ 613.638670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.803318] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8: rpc.has_security_group_logging(os_id): False [ 613.830601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.830853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.831065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.831281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.831696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.831696] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.831891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.832477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.832477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.832477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.832477] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.833092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.833213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.833832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.833983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.834259] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.834403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.834498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.834757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.834881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.834997] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be created. [ 613.837317] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 613.837665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.838879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.839184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.839408] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.839559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.839651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.839847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.839969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.840103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.840715] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.840715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.840715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.840932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.841556] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.842332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.842433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.842603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.842688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.842801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.842897] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.844405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.844595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.845287] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.845287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.845287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.845287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.846715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.847366] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.916864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.917051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.917278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.917356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.917486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.931328] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 614.350040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c33a4c9-c386-4629-b92a-71c04d7941cd: rpc.has_security_group_logging(os_id): False [ 614.351629] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.381695] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.381867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.381938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.382206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.382308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.382592] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.382715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.382849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.382928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.383035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.383206] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.383299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.383360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.383497] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.383569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.383744] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.383836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.383932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.384092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.384172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.384254] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be created. [ 614.457348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.457561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.457909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.457909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.458112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.482344] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 614.855747] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.359668] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.359668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.359668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.359668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.359668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.359668] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 615.389346] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.389689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.389881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.390272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.390564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.401404] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 615.465020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 in Status: SUCCESS [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.465020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.465020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.465020] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.803714] env[65107]: INFO networking_nsxv3.common.synchronization [req-869d097c-d184-4bc9-aae7-db1f9ca1adfc req-68706bbf-5143-477a-8899-c16269050d2f tempest-TenantUsagesTestJSON-2137230175 tempest-TenantUsagesTestJSON-2137230175-project-member] Enqueued Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_members [ 615.804385] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGHEST for action security_group_members [ 615.804630] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.804759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.804828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.805057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.805225] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.805327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.805389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.805552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.806234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.806234] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.945173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 615.945739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.971026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.971026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.971026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.971920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.971920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.971920] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.308477] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.308678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.308752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.309142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.309142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.309336] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.309456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.309601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.309747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.309747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.309851] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 is going to be updated. [ 616.356372] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.356522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.356593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.356967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.357168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.368311] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 in Status: IN_PROGRESS for 2s [ 616.476665] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9: rpc.has_security_group_logging(os_id): False [ 616.495896] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 616.497726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.497726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.497726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.497726] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.498897] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.498897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.498897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.498897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.499139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.499419] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.499504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.499604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.499710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.499790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.501580] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.501580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.501580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.501580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.501580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.501859] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.501859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.501859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.501975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.502026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.502116] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 is going to be created. [ 616.556193] env[65107]: INFO networking_nsxv3.common.synchronization [req-c625bfce-88fb-49ae-bf0a-ba99a4e76df1 req-f6e6eb2e-0a71-4b09-a3b9-6ae72eba18c4 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 616.556193] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 616.556193] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.556193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.556193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.556504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.556634] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.556737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.556799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.556949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.557296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.557383] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.568882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.569052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.569052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.570260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.570260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.583751] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 in Status: IN_PROGRESS for 2s [ 616.991295] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-789 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.992260] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-789" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.992260] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-789" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.992260] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-789" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.992479] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.992621] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.992702] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.992931] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.993159] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.993418] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.993570] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.993679] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.993783] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.996733] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.996733] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.996733] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.005037] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.005344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.015244] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.015313] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.015425] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.016035] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-789" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.016035] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.016228] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.016228] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.016543] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.017304] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cbfccaf-d3a1-4774-b116-a79ae1cc37eb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.064615] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.064767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.064767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.064973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.065104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.065316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.065415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.065490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.065657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.065735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.065840] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 already deleted. [ 617.065942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.413893] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 617.414227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.414391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.414662] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.414953] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.415173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.416199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.416199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.416199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.416199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.416199] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.520038] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.520038] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.520038] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.520038] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.520038] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.520337] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb not found, creating... [ 617.520419] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.520591] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.520717] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.521614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.521614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.521614] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.521614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.521614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.521904] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.522058] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.522167] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb is going to be created. [ 617.547595] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.547595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.547595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.547595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.547595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.547595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.918964] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.919381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.920059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.920059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.920059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.920059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.920293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.920293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.920386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.920480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.920649] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.920741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.920908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.921114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.921286] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.921415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.921483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.922109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.922109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.922235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.922790] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.381403] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 in Status: SUCCESS [ 618.381841] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 deletion is rescheduled due to dependency. [ 618.382211] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.408734] env[65107]: INFO networking_nsxv3.common.synchronization [req-c625bfce-88fb-49ae-bf0a-ba99a4e76df1 req-924cfa99-9251-46fb-a36f-6d9adcd2c3b4 service nova] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 618.409055] env[65107]: INFO networking_nsxv3.common.synchronization [req-c625bfce-88fb-49ae-bf0a-ba99a4e76df1 req-924cfa99-9251-46fb-a36f-6d9adcd2c3b4 service nova] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 618.409268] env[65107]: INFO networking_nsxv3.common.synchronization [req-c625bfce-88fb-49ae-bf0a-ba99a4e76df1 req-924cfa99-9251-46fb-a36f-6d9adcd2c3b4 service nova] Enqueued Resource ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with Priority: HIGHEST for action port [ 618.415481] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 618.415979] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 618.415979] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with Priority: HIGHEST for action port [ 618.416417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.416417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.416519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.416729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.416847] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.418175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.418460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.418460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.418724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.418933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.419051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.419139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.419419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.419594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.419810] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.421420] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.421420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.421682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.421947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.421947] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cbfccaf-d3a1-4774-b116-a79ae1cc37eb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.427669] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c33a4c9-c386-4629-b92a-71c04d7941cd: rpc.has_security_group_logging(os_id): False [ 618.449068] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.449592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.449687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.449918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.450071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.450397] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.450535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.450596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.450818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.450940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.451861] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.451861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.452016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.452299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.452427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.452702] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.452859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.452958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.453207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.453319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.453637] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 618.543186] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.543378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.543467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.543733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.543842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.559823] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 618.605715] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 in Status: SUCCESS [ 618.606118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.924932] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with status ACTIVE [ 618.925179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.925301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.925377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.925626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.925711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.925953] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.926093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.926093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.926223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.926300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.926834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.926834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.926834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.926834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.927022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.927022] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb is going to be updated. [ 618.928463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.928557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.928873] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.961042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.961042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.961267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.961620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.962034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.962328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.432753] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.935755] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.935755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.936076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.936257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.936371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.936494] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be created. [ 619.982675] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.982915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.982915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.983160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.983335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.995815] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: UNINITIALIZED for 2s [ 620.580389] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 620.580756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.580992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.581356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.581470] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.084362] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.084517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.084589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.084816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.084996] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.085113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.085188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.085372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.085458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.085547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.085637] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.174142] env[65107]: INFO networking_nsxv3.common.synchronization [req-9898bb37-c2bc-4a6b-b74d-e4ecae44b517 req-87e82686-6b18-4343-aa98-514ad7b38306 tempest-ServerExternalEventsTest-1143963566 tempest-ServerExternalEventsTest-1143963566-project-member] Enqueued Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_members [ 621.174769] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2882833-81aa-4338-b54e-9f9cd3047983 with Priority: HIGHEST for action security_group_members [ 621.176140] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2882833-81aa-4338-b54e-9f9cd3047983 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.176323] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.176397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.176637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.176815] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.176912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.176973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.177139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.177223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.177319] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2882833-81aa-4338-b54e-9f9cd3047983',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.589814] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.590130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.590272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.590642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.590936] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.591142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.591272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.591573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.591745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.591988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.592331] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.592416] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.592521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.592818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.593116] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.597104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.597225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.597455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.597557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.597698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.598727] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.679617] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.679839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.679902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.680135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.680226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.680430] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.680545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.680605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.680733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.680982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.681395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2882833-81aa-4338-b54e-9f9cd3047983 is going to be updated. [ 621.720914] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.721111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.721230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.721478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.721665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.740890] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2882833-81aa-4338-b54e-9f9cd3047983 in Status: IN_PROGRESS for 2s [ 622.008993] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 622.009713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.009843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.010108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.010382] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.010510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.010552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.010762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.010852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.010969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.011194] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.044326] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3d76e3f4-fcb2-42c5-8e4c-64aaacfa29ae None None] Enqueued Resource ID: 65554d9c-8c51-4ded-97c2-8543d960f4ed with Priority: HIGHEST for action port [ 622.046878] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65554d9c-8c51-4ded-97c2-8543d960f4ed with Priority: HIGHEST for action port [ 622.049955] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-65554d9c-8c51-4ded-97c2-8543d960f4ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.049955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65554d9c-8c51-4ded-97c2-8543d960f4ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.049955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65554d9c-8c51-4ded-97c2-8543d960f4ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.049955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65554d9c-8c51-4ded-97c2-8543d960f4ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.049955] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65554d9c-8c51-4ded-97c2-8543d960f4ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.104284] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c33a4c9-c386-4629-b92a-71c04d7941cd: rpc.has_security_group_logging(os_id): False [ 622.127794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.127892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.128070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.128382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.128474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.128805] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.128898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.128965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.130367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.130367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.130367] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.130367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.130367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.130367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.130367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.131554] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.131679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.131728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.131910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.131984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.132096] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 622.216653] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.216653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.216653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.216885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.216986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.256729] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 622.514951] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.552405] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65554d9c-8c51-4ded-97c2-8543d960f4ed [ 622.552732] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.552824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.552920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.553240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.553337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.553455] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65554d9c-8c51-4ded-97c2-8543d960f4ed already deleted. [ 622.556618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65554d9c-8c51-4ded-97c2-8543d960f4ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.019931] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de5bb9f6-dc07-4ba1-9bf0-e549fa218d60: rpc.has_security_group_logging(os_id): False [ 623.042031] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.042031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.042220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.042319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.042403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.042680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.042807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.043533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.043533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.043533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.043533] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be created. [ 623.120047] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.120047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.120296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.120296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.121289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.134669] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 623.219066] env[65107]: INFO networking_nsxv3.common.synchronization [req-0612dc5c-fdea-437e-a038-46577bbdb2a1 req-6d99f8d6-7f34-4f87-8fb6-071659329dfd tempest-ServerDiagnosticsNegativeTest-1172872999 tempest-ServerDiagnosticsNegativeTest-1172872999-project-member] Enqueued Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_members [ 623.219066] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_members [ 623.219066] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.219066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.219066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.219066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.219066] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.219066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.219066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.221341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.221608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.221769] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.727034] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.727221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.727304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.727577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.727732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.728034] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.728166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.728207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.728506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.728506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.728659] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 already deleted. [ 623.728659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.754241] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2882833-81aa-4338-b54e-9f9cd3047983 in Status: SUCCESS [ 623.754241] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2882833-81aa-4338-b54e-9f9cd3047983 deletion is rescheduled due to dependency. [ 623.754241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2882833-81aa-4338-b54e-9f9cd3047983" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.913688] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.913688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.913688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.913688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.913688] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.913688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.913688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.913688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.913688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.914164] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.914164] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.914164] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.914164] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.914334] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.915518] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.915518] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.938738] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.938881] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.939017] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.939198] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.939578] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.940115] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.940115] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.940384] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.941270] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e1bac7d-89cb-480e-9ad0-e42d6939a63d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.275900] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 624.276249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.447026] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.447026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 7e1bac7d-89cb-480e-9ad0-e42d6939a63d not found, creating... [ 624.447026] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.447026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.447729] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.447729] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.447729] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.447729] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.447899] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.448240] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 7e1bac7d-89cb-480e-9ad0-e42d6939a63d is going to be created. [ 624.471615] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.471852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.472063] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.472398] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.472641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.472869] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.910572] env[65107]: INFO networking_nsxv3.common.synchronization [None req-777191bc-5dbb-4cb9-af2d-d27386e95da7 None None] Enqueued Resource ID: cd6bf9d0-c9be-47a0-ae59-032953284d79 with Priority: HIGHEST for action port [ 624.911488] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd6bf9d0-c9be-47a0-ae59-032953284d79 with Priority: HIGHEST for action port [ 624.911488] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd6bf9d0-c9be-47a0-ae59-032953284d79 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.911643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd6bf9d0-c9be-47a0-ae59-032953284d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.912057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd6bf9d0-c9be-47a0-ae59-032953284d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.912057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd6bf9d0-c9be-47a0-ae59-032953284d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.912057] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd6bf9d0-c9be-47a0-ae59-032953284d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.153234] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 625.153234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.197123] env[65107]: INFO networking_nsxv3.common.synchronization [req-0612dc5c-fdea-437e-a038-46577bbdb2a1 req-ee0d1bdb-1d5d-497b-952b-fa7413d3a35b service nova] Enqueued Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_rules [ 625.197123] env[65107]: INFO networking_nsxv3.common.synchronization [req-0612dc5c-fdea-437e-a038-46577bbdb2a1 req-ee0d1bdb-1d5d-497b-952b-fa7413d3a35b service nova] Enqueued Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_members [ 625.197123] env[65107]: INFO networking_nsxv3.common.synchronization [req-0612dc5c-fdea-437e-a038-46577bbdb2a1 req-ee0d1bdb-1d5d-497b-952b-fa7413d3a35b service nova] Enqueued Resource ID: 7e1bac7d-89cb-480e-9ad0-e42d6939a63d with Priority: HIGHEST for action port [ 625.197123] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_rules [ 625.197123] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_members [ 625.197620] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e1bac7d-89cb-480e-9ad0-e42d6939a63d with Priority: HIGHEST for action port [ 625.198107] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.198528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.198721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.204248] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.204248] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.204248] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.204248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.205345] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.208040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.208040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.208040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.208040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.208040] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e1bac7d-89cb-480e-9ad0-e42d6939a63d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.415551] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd6bf9d0-c9be-47a0-ae59-032953284d79 [ 625.415907] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.416142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.416221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.416446] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.416584] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.416654] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd6bf9d0-c9be-47a0-ae59-032953284d79 already deleted. [ 625.416767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd6bf9d0-c9be-47a0-ae59-032953284d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.683045] env[65107]: INFO networking_nsxv3.common.synchronization [None req-cd3befb1-6aea-41cd-b7e7-3cffad54e3a8 None None] Enqueued Resource ID: f8d3d80e-cd90-4f86-a125-ffd035af2d39 with Priority: HIGHEST for action port [ 625.683625] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d3d80e-cd90-4f86-a125-ffd035af2d39 with Priority: HIGHEST for action port [ 625.683937] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8d3d80e-cd90-4f86-a125-ffd035af2d39 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.684265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8d3d80e-cd90-4f86-a125-ffd035af2d39" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.684361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8d3d80e-cd90-4f86-a125-ffd035af2d39" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.685121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8d3d80e-cd90-4f86-a125-ffd035af2d39" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.685235] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8d3d80e-cd90-4f86-a125-ffd035af2d39',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.711982] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.713208] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.713403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.713620] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e1bac7d-89cb-480e-9ad0-e42d6939a63d with status ACTIVE [ 625.714082] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.714082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.714257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.714396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.714509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.714721] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.718064] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.718064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.718064] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e1bac7d-89cb-480e-9ad0-e42d6939a63d is going to be updated. [ 625.752984] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.752984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.752984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.752984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.752984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.752984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e1bac7d-89cb-480e-9ad0-e42d6939a63d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.146060] env[65107]: INFO networking_nsxv3.common.synchronization [req-f9eb2bae-860c-4f83-85fa-f30ccba3e865 req-0cb0c5da-dcc3-4c4f-adc4-e59409639dcf tempest-ImagesNegativeTestJSON-1342465760 tempest-ImagesNegativeTestJSON-1342465760-project-member] Enqueued Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_members [ 626.146404] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_members [ 626.148254] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e382ab2d-f671-4098-ac12-6a8786603007 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.148371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.148371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.148644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.148802] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.148934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.149037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.149418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.149418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.149418] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.188360] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8d3d80e-cd90-4f86-a125-ffd035af2d39 [ 626.188580] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.188710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.188779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.189079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.189322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.189322] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8d3d80e-cd90-4f86-a125-ffd035af2d39 already deleted. [ 626.189448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8d3d80e-cd90-4f86-a125-ffd035af2d39" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.219654] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.595753] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.595753] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-737" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.595753] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-737" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.596339] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-737" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.597385] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.597584] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.597701] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.597934] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.598136] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.599483] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.599602] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.599709] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.599815] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.599922] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.600032] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.600163] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.623115] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.623115] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.623276] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.623499] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-737" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.623850] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-d2d61631-f337-4a19-b70d-6c7270095184 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.624103] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.624239] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.624550] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.624736] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2d61631-f337-4a19-b70d-6c7270095184',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.653424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.653581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.653650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.653868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.653963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.654179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.654279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.654339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.654488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.654565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.654649] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e382ab2d-f671-4098-ac12-6a8786603007 already deleted. [ 626.654729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.726513] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.726669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.726740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.726955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.727066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.727165] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 is going to be created. [ 626.757866] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.757866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.757866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.757866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.757866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.771629] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 in Status: UNINITIALIZED for 2s [ 627.129361] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.129361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.129361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.129361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.129361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.129361] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port d2d61631-f337-4a19-b70d-6c7270095184 not found, creating... [ 627.130312] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.130312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.130312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.130312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.130312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.130586] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.130783] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.130921] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.131546] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.131807] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.132363] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: d2d61631-f337-4a19-b70d-6c7270095184 is going to be created. [ 627.158894] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.159226] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.159429] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.159791] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.161504] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.161987] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.489128] env[65107]: INFO networking_nsxv3.common.synchronization [None req-ec914a26-039c-49f0-a636-8926d40496b2 None None] Enqueued Resource ID: 7d69abe1-dc5e-43ec-be28-e3d00128b051 with Priority: HIGHEST for action port [ 627.490053] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d69abe1-dc5e-43ec-be28-e3d00128b051 with Priority: HIGHEST for action port [ 627.490175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d69abe1-dc5e-43ec-be28-e3d00128b051 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.490348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d69abe1-dc5e-43ec-be28-e3d00128b051" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.490423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d69abe1-dc5e-43ec-be28-e3d00128b051" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.490676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d69abe1-dc5e-43ec-be28-e3d00128b051" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.490761] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d69abe1-dc5e-43ec-be28-e3d00128b051',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.886132] env[65107]: INFO networking_nsxv3.common.synchronization [req-f9eb2bae-860c-4f83-85fa-f30ccba3e865 req-545fbee3-bc57-4dd5-8b99-4d9f3de7d8d9 service nova] Enqueued Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_rules [ 627.886393] env[65107]: INFO networking_nsxv3.common.synchronization [req-f9eb2bae-860c-4f83-85fa-f30ccba3e865 req-545fbee3-bc57-4dd5-8b99-4d9f3de7d8d9 service nova] Enqueued Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_members [ 627.886393] env[65107]: INFO networking_nsxv3.common.synchronization [req-f9eb2bae-860c-4f83-85fa-f30ccba3e865 req-545fbee3-bc57-4dd5-8b99-4d9f3de7d8d9 service nova] Enqueued Resource ID: d2d61631-f337-4a19-b70d-6c7270095184 with Priority: HIGHEST for action port [ 627.886871] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_rules [ 627.887025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_members [ 627.889714] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2d61631-f337-4a19-b70d-6c7270095184 with Priority: HIGHEST for action port [ 627.890097] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e382ab2d-f671-4098-ac12-6a8786603007 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.890543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.890543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.890651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.890732] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.891691] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e382ab2d-f671-4098-ac12-6a8786603007 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.891818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.891882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.892078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.892237] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.892336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.892394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.892541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.892622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.892712] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.894309] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2d61631-f337-4a19-b70d-6c7270095184 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.894419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.894484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.894636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.895166] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2d61631-f337-4a19-b70d-6c7270095184',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.993022] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d69abe1-dc5e-43ec-be28-e3d00128b051 [ 627.993297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.993451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.993525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.994194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.994336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.994478] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d69abe1-dc5e-43ec-be28-e3d00128b051 already deleted. [ 627.994574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d69abe1-dc5e-43ec-be28-e3d00128b051" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.053386] env[65107]: INFO networking_nsxv3.common.synchronization [None req-707baef5-3fb1-4203-88be-5cad13dec040 None None] Enqueued Resource ID: f624ff72-703b-44c4-833a-47604c7d70cd with Priority: HIGHEST for action port [ 628.053984] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f624ff72-703b-44c4-833a-47604c7d70cd with Priority: HIGHEST for action port [ 628.054341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f624ff72-703b-44c4-833a-47604c7d70cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.054492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f624ff72-703b-44c4-833a-47604c7d70cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.054556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f624ff72-703b-44c4-833a-47604c7d70cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.054832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f624ff72-703b-44c4-833a-47604c7d70cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.054934] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f624ff72-703b-44c4-833a-47604c7d70cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.398987] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.400510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e382ab2d-f671-4098-ac12-6a8786603007 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.401795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.405142] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2d61631-f337-4a19-b70d-6c7270095184 with status ACTIVE [ 628.405142] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.405142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.405142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.405142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.405142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.405532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.405747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.405899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.406197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.407199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.408440] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.408702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.408865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.409283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.411553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.411553] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2d61631-f337-4a19-b70d-6c7270095184 is going to be updated. [ 628.442389] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.442575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.442645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.442857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.442996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.443187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2d61631-f337-4a19-b70d-6c7270095184" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.558877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f624ff72-703b-44c4-833a-47604c7d70cd [ 628.558877] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.558877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.558877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.558877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.558877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.558877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f624ff72-703b-44c4-833a-47604c7d70cd already deleted. [ 628.558877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f624ff72-703b-44c4-833a-47604c7d70cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.784961] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 in Status: SUCCESS [ 628.785482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.785482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.785823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.785823] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.786529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.786529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.786529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.786529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.786529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.786783] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.913032] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.289603] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.289603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.289603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.289912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.290116] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.290231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.290279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.293537] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.293537] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.293537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.293537] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.416034] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.416182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.416182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.416410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.416571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.416676] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e382ab2d-f671-4098-ac12-6a8786603007 is going to be created. [ 629.444376] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.444621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.444621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.444746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.445345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.456877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e382ab2d-f671-4098-ac12-6a8786603007 in Status: UNINITIALIZED for 2s [ 629.580847] env[65107]: INFO networking_nsxv3.common.synchronization [None req-05c3b2ec-d35c-4805-8c36-5160b0a3cdb9 None None] Enqueued Resource ID: 931a7daa-03a7-46d5-b73a-70b5515900e0 with Priority: HIGHEST for action port [ 629.581608] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 931a7daa-03a7-46d5-b73a-70b5515900e0 with Priority: HIGHEST for action port [ 629.582030] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-931a7daa-03a7-46d5-b73a-70b5515900e0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.582197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-931a7daa-03a7-46d5-b73a-70b5515900e0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.582287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-931a7daa-03a7-46d5-b73a-70b5515900e0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.582622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-931a7daa-03a7-46d5-b73a-70b5515900e0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.582732] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('931a7daa-03a7-46d5-b73a-70b5515900e0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.795494] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083: rpc.has_security_group_logging(os_id): False [ 629.815203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.815514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.815590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.815913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.816116] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.816438] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.816606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.816722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.816991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.817162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.817809] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.817809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.818085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.818185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.818368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.818638] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.818762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.818850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.819080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.819234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.819365] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 is going to be created. [ 629.887749] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.887749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.887749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.887749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.887749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.902182] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 in Status: IN_PROGRESS for 2s [ 630.089032] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 931a7daa-03a7-46d5-b73a-70b5515900e0 [ 630.089032] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.089392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.089392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.089468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.089518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.089610] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:931a7daa-03a7-46d5-b73a-70b5515900e0 already deleted. [ 630.089692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-931a7daa-03a7-46d5-b73a-70b5515900e0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.638866] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a5a2ecb-9489-4103-a2bf-49c9ba993a07 req-102bd3ee-b99d-4626-92a8-4552a93b279b tempest-ServersWithSpecificFlavorTestJSON-1770061733 tempest-ServersWithSpecificFlavorTestJSON-1770061733-project-member] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 630.639617] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 630.639971] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.640071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.640147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.640445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.640559] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.640664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.640731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.640865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.640949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.641058] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.650870] env[65107]: INFO networking_nsxv3.common.synchronization [None req-bbf6a713-fe3c-49dc-921f-2aa8c441c477 None None] Enqueued Resource ID: 03cf0fae-6195-49e3-a761-c17f9be9f036 with Priority: HIGHEST for action port [ 630.651610] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03cf0fae-6195-49e3-a761-c17f9be9f036 with Priority: HIGHEST for action port [ 630.652086] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-03cf0fae-6195-49e3-a761-c17f9be9f036 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.652086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03cf0fae-6195-49e3-a761-c17f9be9f036" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.652086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03cf0fae-6195-49e3-a761-c17f9be9f036" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.652368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03cf0fae-6195-49e3-a761-c17f9be9f036" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.652368] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03cf0fae-6195-49e3-a761-c17f9be9f036',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.955039] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.955039] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.955278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.955483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.955851] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.955944] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.956086] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.956412] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.956523] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.956751] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.956884] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.957017] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.957154] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.957287] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.957413] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.957563] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.979513] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.979878] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.979878] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.980075] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.980367] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-ba747193-9624-4c11-8eaf-da1b8aeece31 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.980567] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.980682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.980993] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.981153] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba747193-9624-4c11-8eaf-da1b8aeece31',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.145746] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.146249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.146249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.146454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.146598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.146862] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.147046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.147129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.147384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.147484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.147624] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 already deleted. [ 631.147756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.154283] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03cf0fae-6195-49e3-a761-c17f9be9f036 [ 631.154545] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.154729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.154843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.155107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.155243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.155395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03cf0fae-6195-49e3-a761-c17f9be9f036 already deleted. [ 631.155520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03cf0fae-6195-49e3-a761-c17f9be9f036" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.472837] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e382ab2d-f671-4098-ac12-6a8786603007 in Status: SUCCESS [ 631.473136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.473381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.473615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.473864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.474061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.474166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.474392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.474508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.474607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.474739] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.483489] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.483814] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.483968] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.484304] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.484532] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.484728] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port ba747193-9624-4c11-8eaf-da1b8aeece31 not found, creating... [ 631.485088] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.485303] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.485455] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.485721] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.485959] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.486308] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.486475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.486638] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.486931] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.487707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.487707] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: ba747193-9624-4c11-8eaf-da1b8aeece31 is going to be created. [ 631.512471] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.512752] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.512897] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.513293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.513482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.513608] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.712751] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f5c7323f-65b2-4536-8221-2fd8311d328e None None] Enqueued Resource ID: d467b130-44e5-4a7d-be82-3d849344d3ce with Priority: HIGHEST for action port [ 631.712751] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d467b130-44e5-4a7d-be82-3d849344d3ce with Priority: HIGHEST for action port [ 631.713167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d467b130-44e5-4a7d-be82-3d849344d3ce taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.713293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d467b130-44e5-4a7d-be82-3d849344d3ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.713354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d467b130-44e5-4a7d-be82-3d849344d3ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.713608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d467b130-44e5-4a7d-be82-3d849344d3ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.713690] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d467b130-44e5-4a7d-be82-3d849344d3ce',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.915071] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 in Status: SUCCESS [ 631.915288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.977644] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e382ab2d-f671-4098-ac12-6a8786603007 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.977912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.977912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.978221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.978412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.978518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.978585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.978743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.978831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.978948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.979094] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e382ab2d-f671-4098-ac12-6a8786603007 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.979244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.979348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.979503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.979648] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.979756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.979822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.980016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.980122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.980250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.980363] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.216037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d467b130-44e5-4a7d-be82-3d849344d3ce [ 632.216416] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.216642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.216767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.217505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.217505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.217719] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d467b130-44e5-4a7d-be82-3d849344d3ce already deleted. [ 632.217815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d467b130-44e5-4a7d-be82-3d849344d3ce" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.260575] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a5a2ecb-9489-4103-a2bf-49c9ba993a07 req-c4279688-5b93-4701-84c1-adc6a9b43350 service nova] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 632.260847] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a5a2ecb-9489-4103-a2bf-49c9ba993a07 req-c4279688-5b93-4701-84c1-adc6a9b43350 service nova] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 632.261021] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a5a2ecb-9489-4103-a2bf-49c9ba993a07 req-c4279688-5b93-4701-84c1-adc6a9b43350 service nova] Enqueued Resource ID: ba747193-9624-4c11-8eaf-da1b8aeece31 with Priority: HIGHEST for action port [ 632.261800] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 632.261800] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 632.261967] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba747193-9624-4c11-8eaf-da1b8aeece31 with Priority: HIGHEST for action port [ 632.262305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.262451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.262575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.262717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.262873] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.263936] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.264104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.264185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.264382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.264666] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.264833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.264913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.265151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.265468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.265506] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.266793] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba747193-9624-4c11-8eaf-da1b8aeece31 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.266901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.266945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.267146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.267210] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba747193-9624-4c11-8eaf-da1b8aeece31',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.483095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e382ab2d-f671-4098-ac12-6a8786603007: rpc.has_security_group_logging(os_id): False [ 632.502426] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.502426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.502526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.502838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.502838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.503071] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.503127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.503161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.503308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.503373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.503692] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.503804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.503861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.503994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.504088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.504271] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.504408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.504408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.504564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.504618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.504689] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e382ab2d-f671-4098-ac12-6a8786603007 is going to be created. [ 632.581862] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.581862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.581862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.581862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.581862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.597262] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e382ab2d-f671-4098-ac12-6a8786603007 in Status: IN_PROGRESS for 2s [ 632.770203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.770203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.770203] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.771484] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba747193-9624-4c11-8eaf-da1b8aeece31 with status ACTIVE [ 632.771855] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.772152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.773021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.773021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.773021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.773021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.773021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.773985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.774224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.774297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.774533] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.774641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.774717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.774878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.774956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.775059] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba747193-9624-4c11-8eaf-da1b8aeece31 is going to be updated. [ 632.799235] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.799395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.799436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.799635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.800012] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.800012] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba747193-9624-4c11-8eaf-da1b8aeece31" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.279470] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.616689] env[65107]: INFO networking_nsxv3.common.synchronization [req-ee3d4503-ac05-4b15-9920-7543068c1c9d req-aff45138-061a-4c67-a453-915bbfd8d163 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 633.617046] env[65107]: INFO networking_nsxv3.common.synchronization [req-ee3d4503-ac05-4b15-9920-7543068c1c9d req-aff45138-061a-4c67-a453-915bbfd8d163 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 633.619134] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 633.619134] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 633.619134] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.619134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.619134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.619134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.619456] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.619456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.619456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.619617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.619617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.619701] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.624067] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.624220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.624294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.624645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.624726] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.624805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.624845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.624999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.625410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.625410] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.696362] env[65107]: INFO networking_nsxv3.common.synchronization [req-ee3d4503-ac05-4b15-9920-7543068c1c9d req-aff45138-061a-4c67-a453-915bbfd8d163 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_rules [ 633.696362] env[65107]: INFO networking_nsxv3.common.synchronization [req-ee3d4503-ac05-4b15-9920-7543068c1c9d req-aff45138-061a-4c67-a453-915bbfd8d163 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 633.696362] env[65107]: INFO networking_nsxv3.common.synchronization [req-ee3d4503-ac05-4b15-9920-7543068c1c9d req-aff45138-061a-4c67-a453-915bbfd8d163 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 633.696362] env[65107]: INFO networking_nsxv3.common.synchronization [req-ee3d4503-ac05-4b15-9920-7543068c1c9d req-aff45138-061a-4c67-a453-915bbfd8d163 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 633.696362] env[65107]: INFO networking_nsxv3.common.synchronization [req-ee3d4503-ac05-4b15-9920-7543068c1c9d req-aff45138-061a-4c67-a453-915bbfd8d163 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: c2612555-7306-4358-a885-84ba8985ecc9 with Priority: HIGHEST for action port [ 633.696723] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_rules [ 633.696723] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 633.696787] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2612555-7306-4358-a885-84ba8985ecc9 with Priority: HIGHEST for action port [ 633.696865] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 633.696955] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 633.697248] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.697437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.697483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.697733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.697825] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.699239] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.700455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.700455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.700455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.700455] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.701143] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2612555-7306-4358-a885-84ba8985ecc9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.701143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.701285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.701445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.701607] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2612555-7306-4358-a885-84ba8985ecc9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.702674] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.702758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.702940] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.703037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.785941] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.785941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.785941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.785941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.785941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.785941] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be created. [ 633.812387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.812638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.812638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.812811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.812970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.825905] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: UNINITIALIZED for 2s [ 634.126957] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.134657] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.200510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.200732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.201473] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.201570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.203098] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2612555-7306-4358-a885-84ba8985ecc9 with status ACTIVE [ 634.203808] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.203945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.204025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.204708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.204835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.206015] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.206109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.206156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.206314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.206404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.206594] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.206690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.206747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.206888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.206983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.207100] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2612555-7306-4358-a885-84ba8985ecc9 is going to be updated. [ 634.238211] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.238399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.238476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.238719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.238878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.239093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.617509] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e382ab2d-f671-4098-ac12-6a8786603007 in Status: SUCCESS [ 634.617509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.639031] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.640612] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.142305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.142393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.142445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.142771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.142892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.143058] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 635.144893] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.144893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.144893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.145224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.145290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.146072] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be created. [ 635.180025] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.180236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.180287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.180524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.180746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.196664] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.197416] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.197598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.197763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.197891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.208072] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: UNINITIALIZED for 2s [ 635.214173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 635.839745] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 635.840045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.840168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.840449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.840628] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.840753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.840838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.841041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.841127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.841217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.841309] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.345335] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.847913] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5a9e810-a93e-4373-b821-f175316f25f4: rpc.has_security_group_logging(os_id): False [ 636.874291] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.876236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.882944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.882944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.882944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.882944] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.882944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.882944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.882944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.882944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.882944] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be created. [ 636.927689] env[65107]: INFO networking_nsxv3.common.synchronization [None req-72b71340-7112-4a39-9f47-fdfe34a64794 None None] Enqueued Resource ID: 9138d942-cdc6-4bb7-81ba-c20c91672e43 with Priority: HIGHEST for action port [ 636.929301] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9138d942-cdc6-4bb7-81ba-c20c91672e43 with Priority: HIGHEST for action port [ 636.929671] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-9138d942-cdc6-4bb7-81ba-c20c91672e43 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.930523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9138d942-cdc6-4bb7-81ba-c20c91672e43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.930523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9138d942-cdc6-4bb7-81ba-c20c91672e43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.930760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9138d942-cdc6-4bb7-81ba-c20c91672e43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.930881] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9138d942-cdc6-4bb7-81ba-c20c91672e43',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.958818] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.959135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.959135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.959435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.959647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.975514] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: IN_PROGRESS for 2s [ 637.220040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 637.220272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.220489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.220720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.220900] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.224324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.224511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.224726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.225630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.225630] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.229638] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 637.229694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.230090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.230170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.230318] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.230439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.230502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.230653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.230736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.230829] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.433830] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9138d942-cdc6-4bb7-81ba-c20c91672e43 [ 637.434173] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.434374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.434467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.434878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.435011] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.435128] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9138d942-cdc6-4bb7-81ba-c20c91672e43 already deleted. [ 637.435245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9138d942-cdc6-4bb7-81ba-c20c91672e43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.604980] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 637.604980] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 637.604980] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_members [ 637.609881] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 637.610333] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 637.610662] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_members [ 637.611471] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.611732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.612093] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.612315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.612668] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-f472a668-4442-488d-936d-2a700ed0a421 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.614435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.614435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.614435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.614435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.614682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.614831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.615113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.615298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.615496] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.657452] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_rules [ 637.657562] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 637.657682] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 637.657804] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 637.657923] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_rules [ 637.658441] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_members [ 637.658441] env[65107]: INFO networking_nsxv3.common.synchronization [req-31b5fcfb-1b5d-47f8-92c7-8d4eb63e7600 req-bcada080-d37e-4980-926b-c318ec07f117 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: c2612555-7306-4358-a885-84ba8985ecc9 with Priority: HIGHEST for action port [ 637.659259] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_rules [ 637.659472] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 637.659684] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_members [ 637.659726] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2612555-7306-4358-a885-84ba8985ecc9 with Priority: HIGHEST for action port [ 637.659781] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_rules [ 637.659960] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 637.659960] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 637.660514] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.660622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.660817] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.660892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.661143] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-f472a668-4442-488d-936d-2a700ed0a421 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.661221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.662033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2612555-7306-4358-a885-84ba8985ecc9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.662033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.662033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.662033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.662033] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2612555-7306-4358-a885-84ba8985ecc9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.663183] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f472a668-4442-488d-936d-2a700ed0a421 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.663183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.663183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.663470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.663470] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.664097] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.664193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.664379] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.664945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.729269] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.733787] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.818250] env[65107]: INFO networking_nsxv3.common.synchronization [req-20d1755a-020d-4e43-83c4-2e1d95926ca1 req-cc4a393b-9542-42ed-b4fb-a9998e591089 tempest-ServerAddressesNegativeTestJSON-1722856828 tempest-ServerAddressesNegativeTestJSON-1722856828-project-member] Enqueued Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_members [ 637.818859] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGHEST for action security_group_members [ 637.820657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.820774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.820834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.821414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.821414] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.821414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.821414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.821637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.821637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.821789] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.862039] env[65107]: INFO networking_nsxv3.common.synchronization [None req-41f38207-dc4c-42a7-a855-97f3999ae1ee None None] Enqueued Resource ID: 8879a66e-faf1-487f-8769-ae5830e80d00 with Priority: HIGHEST for action port [ 637.862641] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8879a66e-faf1-487f-8769-ae5830e80d00 with Priority: HIGHEST for action port [ 637.862985] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8879a66e-faf1-487f-8769-ae5830e80d00 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.863542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8879a66e-faf1-487f-8769-ae5830e80d00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.863643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8879a66e-faf1-487f-8769-ae5830e80d00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.864069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8879a66e-faf1-487f-8769-ae5830e80d00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.864176] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8879a66e-faf1-487f-8769-ae5830e80d00',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.119429] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.168636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-f472a668-4442-488d-936d-2a700ed0a421 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.168783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.168946] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2612555-7306-4358-a885-84ba8985ecc9 with status ACTIVE [ 638.169181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.169343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.169449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.169775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.170834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.170834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.170834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.170834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.170834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.170834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.170834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.170834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.171243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.171243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.171243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.171343] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2612555-7306-4358-a885-84ba8985ecc9 is going to be updated. [ 638.196265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.197029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.197029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.197029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.197029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.197288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2612555-7306-4358-a885-84ba8985ecc9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.231343] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.238316] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.325177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.325177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.325177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.326760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.326760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.326760] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.326760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.326760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.326760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.326760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.326760] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae409816-e898-46fe-b06e-b955dd9008ef is going to be updated. [ 638.366435] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8879a66e-faf1-487f-8769-ae5830e80d00 [ 638.366828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.367320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.367494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.367799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.371169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.371169] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8879a66e-faf1-487f-8769-ae5830e80d00 already deleted. [ 638.371169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8879a66e-faf1-487f-8769-ae5830e80d00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.371440] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.371440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.371440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.371634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.371730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.389780] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae409816-e898-46fe-b06e-b955dd9008ef in Status: IN_PROGRESS for 2s [ 638.622623] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.733926] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.734183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.734382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.735438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.735438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.735438] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be updated. [ 638.742108] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.742362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.742639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.744154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.744154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.744154] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 638.779028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.779028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.779028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.779028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.779028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.782437] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.782821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.782821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.782821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.782964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.799234] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 638.799234] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: IN_PROGRESS for 2s [ 638.990180] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 638.990430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.130595] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.130762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.130846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.131104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.131176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.131271] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f472a668-4442-488d-936d-2a700ed0a421 is going to be created. [ 639.161631] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.161631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.161631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.161890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.161927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.175482] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: UNINITIALIZED for 2s [ 639.421893] env[65107]: INFO networking_nsxv3.common.synchronization [req-7e55c8bb-5e36-4459-a107-95562a1e9c6b req-687fca48-aee2-49f0-bc3e-23ef6abdc638 tempest-ServerMetadataNegativeTestJSON-1601808360 tempest-ServerMetadataNegativeTestJSON-1601808360-project-member] Enqueued Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_members [ 639.422827] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_members [ 639.423776] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.423776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.423776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.424331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.424799] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.425453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.425453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.425453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.425453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.425808] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.799181] env[65107]: INFO networking_nsxv3.common.synchronization [None req-be43c942-cf8c-4c44-a84c-3b0bfc143150 None None] Enqueued Resource ID: 3c0d3005-0d53-404f-86f0-2b65834d6d07 with Priority: HIGHEST for action port [ 639.800346] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c0d3005-0d53-404f-86f0-2b65834d6d07 with Priority: HIGHEST for action port [ 639.800346] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c0d3005-0d53-404f-86f0-2b65834d6d07 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.800820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c0d3005-0d53-404f-86f0-2b65834d6d07" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.800820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c0d3005-0d53-404f-86f0-2b65834d6d07" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.800820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c0d3005-0d53-404f-86f0-2b65834d6d07" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.800820] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c0d3005-0d53-404f-86f0-2b65834d6d07',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.874537] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.874727] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-877" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.874892] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-877" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.876145] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-877" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.876322] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.876476] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.877738] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.877738] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.877738] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.877738] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.877738] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.877738] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.877738] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.877738] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.877738] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.877738] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.904319] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.904512] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.904590] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.904759] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-877" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.905299] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-f42d516d-315c-4179-8cab-12609c846dac taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.905447] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.905540] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.906202] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.906202] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42d516d-315c-4179-8cab-12609c846dac',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.929072] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.929375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.929375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.930365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.930365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.930365] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.930365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.930365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.930365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.930365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.930365] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c78203ee-b32f-401b-9764-682ada8423c6 already deleted. [ 639.930365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.305564] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c0d3005-0d53-404f-86f0-2b65834d6d07 [ 640.305943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.306182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.306244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.306513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.306571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.306669] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c0d3005-0d53-404f-86f0-2b65834d6d07 already deleted. [ 640.306804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c0d3005-0d53-404f-86f0-2b65834d6d07" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.400486] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae409816-e898-46fe-b06e-b955dd9008ef in Status: SUCCESS [ 640.400776] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae409816-e898-46fe-b06e-b955dd9008ef deletion is rescheduled due to dependency. [ 640.400776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.408155] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.408471] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.408697] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.408953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.409284] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.409453] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port f42d516d-315c-4179-8cab-12609c846dac not found, creating... [ 640.409738] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.409938] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.410135] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.410527] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.410527] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.410835] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.411043] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.411188] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.411568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.411751] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.411890] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: f42d516d-315c-4179-8cab-12609c846dac is going to be created. [ 640.432924] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.436024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.436024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.436024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.436024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.436024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.815028] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.815028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.815028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.815028] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.819273] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 640.819616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.819762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.819971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.820212] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.820858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.821451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.821451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.821451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.821451] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.822331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.823643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.823925] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.824470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.824470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.824470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.824470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.824791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.824791] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.825777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.825953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.826163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.826685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.826685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.826685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.826685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.826685] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.084771] env[65107]: INFO networking_nsxv3.common.synchronization [None req-60f7ce8f-3db9-4a49-a8fa-df068f076722 None None] Enqueued Resource ID: d0ba7ef9-3d89-4984-9818-475bae065c6e with Priority: HIGHEST for action port [ 641.086342] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ba7ef9-3d89-4984-9818-475bae065c6e with Priority: HIGHEST for action port [ 641.087719] env[65107]: INFO networking_nsxv3.common.synchronization [None req-44af1a98-a3d1-4828-9f98-0c05dba17f09 tempest-ServersV294TestFqdnHostnames-382574538 tempest-ServersV294TestFqdnHostnames-382574538-project-member] Enqueued Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_rules [ 641.087719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0ba7ef9-3d89-4984-9818-475bae065c6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.087719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0ba7ef9-3d89-4984-9818-475bae065c6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.087719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0ba7ef9-3d89-4984-9818-475bae065c6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.087970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0ba7ef9-3d89-4984-9818-475bae065c6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.088256] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0ba7ef9-3d89-4984-9818-475bae065c6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.089299] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_rules [ 641.090046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.092065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.092065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.092065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.092065] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.189029] env[65107]: INFO networking_nsxv3.common.synchronization [req-7e55c8bb-5e36-4459-a107-95562a1e9c6b req-ee0907da-5c1d-431b-bf67-968ccd989466 service nova] Enqueued Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_rules [ 641.189294] env[65107]: INFO networking_nsxv3.common.synchronization [req-7e55c8bb-5e36-4459-a107-95562a1e9c6b req-ee0907da-5c1d-431b-bf67-968ccd989466 service nova] Enqueued Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_members [ 641.189674] env[65107]: INFO networking_nsxv3.common.synchronization [req-7e55c8bb-5e36-4459-a107-95562a1e9c6b req-ee0907da-5c1d-431b-bf67-968ccd989466 service nova] Enqueued Resource ID: f42d516d-315c-4179-8cab-12609c846dac with Priority: HIGHEST for action port [ 641.190445] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: SUCCESS [ 641.191024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.191382] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_rules [ 641.191518] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_members [ 641.191615] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f42d516d-315c-4179-8cab-12609c846dac with Priority: HIGHEST for action port [ 641.191787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.192010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.192204] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.192351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.192395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.192537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.192709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.192827] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.195185] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.195185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.195185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.195185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.195185] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.198533] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.198533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.198533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.198737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.198997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.199157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.199234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.199394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.199481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.199576] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.200460] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f42d516d-315c-4179-8cab-12609c846dac taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.200553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.200605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.200756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.200833] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42d516d-315c-4179-8cab-12609c846dac',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.326695] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.327253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.327253] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.328466] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.329686] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.351549] env[65107]: INFO networking_nsxv3.common.synchronization [req-afd42caf-93df-4f52-91d3-c72e4401ec7f req-ae8fb23e-a856-4eba-85e4-33f9b88d1fe5 tempest-ServerDiagnosticsTest-1900989293 tempest-ServerDiagnosticsTest-1900989293-project-member] Enqueued Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_members [ 641.352342] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGHEST for action security_group_members [ 641.352668] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.352813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.352859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.353083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.353246] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.353351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.353673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.353673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.353885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.353885] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.479664] env[65107]: INFO networking_nsxv3.common.synchronization [None req-b1ab92ea-74f9-41bf-96fb-d3d5e9d83d5a tempest-ServersV294TestFqdnHostnames-382574538 tempest-ServersV294TestFqdnHostnames-382574538-project-member] Enqueued Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_rules [ 641.480247] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_rules [ 641.480665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.480815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.590733] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0ba7ef9-3d89-4984-9818-475bae065c6e [ 641.590966] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.591125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.591191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.591414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.591504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.591600] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0ba7ef9-3d89-4984-9818-475bae065c6e already deleted. [ 641.591683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0ba7ef9-3d89-4984-9818-475bae065c6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.615323] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.615430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.615489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.615708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.615973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.615973] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 already deleted. [ 641.615973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.616157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.616262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.617291] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.711510] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.711510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.711510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.711510] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.721553] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f42d516d-315c-4179-8cab-12609c846dac with status ACTIVE [ 641.721553] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.721732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.721732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.721967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.722098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.722291] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.722414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.722478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.722654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.722730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.722986] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.723087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.723129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.723261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.723333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.723607] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f42d516d-315c-4179-8cab-12609c846dac is going to be updated. [ 641.749867] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.749989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.750039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.750281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.750448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.750627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f42d516d-315c-4179-8cab-12609c846dac" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.835029] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.835029] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20dddc20-b178-4d49-afa2-bbeaf4630ee9: rpc.has_security_group_logging(os_id): False [ 641.835029] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.856786] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.857143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.857272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.857484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.857591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.857881] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.858042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.858139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.858386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.858567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.858667] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 is going to be updated. [ 641.861760] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.861961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.861961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.862165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.862246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.862464] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.862621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.862621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.862760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.862829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.862915] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be created. [ 641.930864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.931029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.931093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.931315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.931474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.944427] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 in Status: IN_PROGRESS for 2s [ 641.969371] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.969595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.969595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.969825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.970149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.986707] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: IN_PROGRESS for 2s [ 642.155171] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.155171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.155171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.155171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.155171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.155171] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 already deleted. [ 642.155171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.213419] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.215328] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.338498] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.339028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.339028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.339182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.339239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.339308] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 642.342466] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.342720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.342849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.343235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.343408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.343550] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be updated. [ 642.412124] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.412269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.412346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.412699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.412699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.415077] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.415298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.415298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.415525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.415673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.429684] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 642.430743] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: IN_PROGRESS for 2s [ 642.721230] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.721230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.721230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.721230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.721230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.721230] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f472a668-4442-488d-936d-2a700ed0a421 is going to be updated. [ 642.721932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.723036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.723036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.723036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.723036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.723036] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c78203ee-b32f-401b-9764-682ada8423c6 is going to be created. [ 642.724470] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0216973-ce2e-4506-83e4-b4ae055c1916 req-06d826f0-a1d4-4b1e-b0bd-ca1819418d3e tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 642.725577] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 642.726369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.726502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.726582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.726850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.727026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.727125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.727185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.727343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.727422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.727516] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.757970] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.757970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.757970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.757970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.757970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.760701] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.760849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.760909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.761079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.761215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.775164] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: IN_PROGRESS for 2s [ 642.777689] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c78203ee-b32f-401b-9764-682ada8423c6 in Status: UNINITIALIZED for 2s [ 643.231529] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.231812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.231812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.232049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.232174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.232387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.232456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.232510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.232671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.232771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.232845] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d already deleted. [ 643.233381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.347688] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-100 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.348177] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.348177] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.350365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.350365] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.350365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.350365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.350365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.350365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.350365] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.350365] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.350365] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.350365] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.350959] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.350959] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.350959] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.391052] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.391297] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.391373] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.391545] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.391867] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-d4102d4e-3558-47f5-9754-678a2a00866e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.392049] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.392164] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.392506] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.392641] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4102d4e-3558-47f5-9754-678a2a00866e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.581072] env[65107]: INFO networking_nsxv3.common.synchronization [None req-cd9c3618-4dd4-4476-85c3-cb004f779ed7 None None] Enqueued Resource ID: f25b812c-77ce-438e-9752-aa45f5c0fecd with Priority: HIGHEST for action port [ 643.581655] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f25b812c-77ce-438e-9752-aa45f5c0fecd with Priority: HIGHEST for action port [ 643.581992] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f25b812c-77ce-438e-9752-aa45f5c0fecd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.582357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f25b812c-77ce-438e-9752-aa45f5c0fecd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.582357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f25b812c-77ce-438e-9752-aa45f5c0fecd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.582474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f25b812c-77ce-438e-9752-aa45f5c0fecd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.582544] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f25b812c-77ce-438e-9752-aa45f5c0fecd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.896386] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.896740] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.897774] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.897774] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.897774] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.897774] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port d4102d4e-3558-47f5-9754-678a2a00866e not found, creating... [ 643.898096] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.898331] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.898475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.898707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.898849] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.899196] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.899478] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.899538] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.899736] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.899864] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.899998] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: d4102d4e-3558-47f5-9754-678a2a00866e is going to be created. [ 643.921190] env[65107]: INFO networking_nsxv3.common.synchronization [req-c101bd08-ab0e-4e8c-bd6e-322056888fe7 req-a554b981-c1a7-4809-bc8e-d0d919927867 tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 643.922068] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 643.922445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.922579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.922643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.922865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.923420] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.923538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.923609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.923777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.923868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.923966] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.925670] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.925854] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.926640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.926640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.926640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.926640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.954983] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 in Status: SUCCESS [ 643.955214] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 deletion is rescheduled due to dependency. [ 643.955336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.999712] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 643.999712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.000406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.000716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.000839] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.086263] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f25b812c-77ce-438e-9752-aa45f5c0fecd [ 644.086521] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.087520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.087520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.087520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.087520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.087520] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f25b812c-77ce-438e-9752-aa45f5c0fecd already deleted. [ 644.087520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f25b812c-77ce-438e-9752-aa45f5c0fecd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.385351] env[65107]: INFO networking_nsxv3.common.synchronization [req-c101bd08-ab0e-4e8c-bd6e-322056888fe7 req-5e961f0f-4ab5-434f-9ea9-ee51c1fd8c27 tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 644.386016] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 644.387914] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.387914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.428837] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.443883] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 644.444218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.444401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.444615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.444796] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.445078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.445144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.445769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.445835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.447119] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.448142] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 644.448142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.448398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.448475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.448644] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.448747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.448805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.448937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.449019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.449105] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.503667] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.504171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.649529] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0216973-ce2e-4506-83e4-b4ae055c1916 req-45068f25-7b6c-4e1c-adc3-4a54ffc48d84 service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 644.649620] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0216973-ce2e-4506-83e4-b4ae055c1916 req-45068f25-7b6c-4e1c-adc3-4a54ffc48d84 service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 644.649755] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0216973-ce2e-4506-83e4-b4ae055c1916 req-45068f25-7b6c-4e1c-adc3-4a54ffc48d84 service nova] Enqueued Resource ID: d4102d4e-3558-47f5-9754-678a2a00866e with Priority: HIGHEST for action port [ 644.650195] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 644.650322] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 644.650963] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4102d4e-3558-47f5-9754-678a2a00866e with Priority: HIGHEST for action port [ 644.650963] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.650963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.650963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.651847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.651847] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.652414] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.652547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.652615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.652785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.652933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.653038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.653122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.653240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.653328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.653419] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.654178] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4102d4e-3558-47f5-9754-678a2a00866e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.654287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.654355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.654495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.654573] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4102d4e-3558-47f5-9754-678a2a00866e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.789559] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: SUCCESS [ 644.789885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.791033] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c78203ee-b32f-401b-9764-682ada8423c6 in Status: SUCCESS [ 644.791299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.792057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.795044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.795260] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.795384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.795451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.795665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.795728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.795777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.795860] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.796709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.796932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.797200] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.797366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.797569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.797693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.797832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.797978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.798720] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.811208] env[65107]: INFO networking_nsxv3.common.synchronization [req-c101bd08-ab0e-4e8c-bd6e-322056888fe7 req-0c224a19-e0a9-4da2-a0ad-27c84547ccee tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 644.811944] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 644.815999] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.815999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.906566] env[65107]: INFO networking_nsxv3.common.synchronization [req-de12e5f4-4fb1-4b21-8133-78629e106884 req-ffdc344c-dab6-4473-8851-a761e4a32552 tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 644.907178] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 644.907703] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.907869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.908234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.908234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.908470] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.908611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.908707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.908905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.909049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.909180] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.933881] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.951154] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.954770] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.159532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.159704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.160078] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4102d4e-3558-47f5-9754-678a2a00866e with status ACTIVE [ 645.160078] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.160293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.160293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.160523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.160523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.160715] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.160800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.160867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.161035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.161186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.161489] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.161489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.161489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.162822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.162822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.162822] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4102d4e-3558-47f5-9754-678a2a00866e is going to be updated. [ 645.167494] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.201145] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.201322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.201322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.201524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.201916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.201916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4102d4e-3558-47f5-9754-678a2a00866e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.301836] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.303054] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.303308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.303391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.306029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.306029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.306029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.306029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.307187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.307187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.307187] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.414037] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.414037] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.414037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.414037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 645.437165] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.437165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.437165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.437165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.437165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.437165] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 645.454648] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.457470] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.458030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.458119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.459034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.459034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.459754] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.473578] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 645.477672] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.477672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.477672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.477672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.477912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.489836] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 645.674545] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.811418] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f472a668-4442-488d-936d-2a700ed0a421: rpc.has_security_group_logging(os_id): False [ 645.811418] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c78203ee-b32f-401b-9764-682ada8423c6: rpc.has_security_group_logging(os_id): False [ 645.829428] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.829428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.829428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.829633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.829740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.829899] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.829992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.832232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.832232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.832232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.832232] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.832232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.832232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.832232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.832232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.832830] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.832830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.832830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.833750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.833845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.834097] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c78203ee-b32f-401b-9764-682ada8423c6 is going to be created. [ 645.835811] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.835876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.835954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.837589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.837589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.837589] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.837589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.837589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.837589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.837589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.837589] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f472a668-4442-488d-936d-2a700ed0a421 is going to be created. [ 645.917118] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.917368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.917368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.917474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.917626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.928755] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.928969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.928969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.929217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.929511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.939348] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: IN_PROGRESS for 2s [ 645.960099] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.960099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.960099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.960099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.960099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.960099] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 645.961547] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c78203ee-b32f-401b-9764-682ada8423c6 in Status: IN_PROGRESS for 2s [ 645.965828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.966396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.966628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.967022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.967254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.967457] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be updated. [ 646.004804] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.004804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.004804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.004804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.004804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.031106] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 646.037199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.037199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.037199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.037199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.037199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.048722] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: IN_PROGRESS for 2s [ 646.120837] env[65107]: INFO networking_nsxv3.common.synchronization [req-62ca381b-8f15-4b88-a461-b38785a3a433 req-9a3fedc8-0b9c-43c5-957f-3dbb44f289ad tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 646.121465] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 646.121781] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.121882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.179016] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.179016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.179164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.179312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.179431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.179549] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be created. [ 646.182347] env[65107]: INFO networking_nsxv3.common.synchronization [None req-ff4d52fe-f9b8-48bc-9d5d-63e380c78f90 None None] Enqueued Resource ID: 556c67fd-d6bc-4b18-a308-1ebb7664408f with Priority: HIGHEST for action port [ 646.182732] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 556c67fd-d6bc-4b18-a308-1ebb7664408f with Priority: HIGHEST for action port [ 646.183512] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-556c67fd-d6bc-4b18-a308-1ebb7664408f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.183634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-556c67fd-d6bc-4b18-a308-1ebb7664408f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.183702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-556c67fd-d6bc-4b18-a308-1ebb7664408f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.183938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-556c67fd-d6bc-4b18-a308-1ebb7664408f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.184043] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('556c67fd-d6bc-4b18-a308-1ebb7664408f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.209158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.210587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.210587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.210587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.210587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.224035] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: UNINITIALIZED for 2s [ 646.631954] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-100 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.632635] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.632907] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.633607] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.635031] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.635031] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.635031] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.635031] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.635031] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.635031] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.635031] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.635031] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.635458] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.635681] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.635900] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.636220] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.656093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.656997] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.657362] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.658268] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.658589] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-61979333-84a6-4e8a-89ac-c631d82b826f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.658767] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.658883] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.659232] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.659374] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61979333-84a6-4e8a-89ac-c631d82b826f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.689085] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 556c67fd-d6bc-4b18-a308-1ebb7664408f [ 646.689085] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.689285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.689336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.689546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.689636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.689923] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:556c67fd-d6bc-4b18-a308-1ebb7664408f already deleted. [ 646.690091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-556c67fd-d6bc-4b18-a308-1ebb7664408f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.163645] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.164278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.164278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.164278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.164435] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.164559] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 61979333-84a6-4e8a-89ac-c631d82b826f not found, creating... [ 647.164813] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.164955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.165083] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.165355] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.165494] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.165849] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.166024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.166024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.166218] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.166392] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.166713] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 61979333-84a6-4e8a-89ac-c631d82b826f is going to be created. [ 647.191570] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.192862] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.192862] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.192862] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.193071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.194235] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.488410] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 647.488410] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 deletion is rescheduled due to dependency. [ 647.488410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.503907] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 647.504426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.504426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.504624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.504817] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.505700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.505700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.505700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.505700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.505700] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.938343] env[65107]: INFO networking_nsxv3.common.synchronization [req-62ca381b-8f15-4b88-a461-b38785a3a433 req-a1eeb384-53ec-41c6-be9f-476ad3ccfe70 service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 647.938343] env[65107]: INFO networking_nsxv3.common.synchronization [req-62ca381b-8f15-4b88-a461-b38785a3a433 req-a1eeb384-53ec-41c6-be9f-476ad3ccfe70 service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 647.938343] env[65107]: INFO networking_nsxv3.common.synchronization [req-62ca381b-8f15-4b88-a461-b38785a3a433 req-a1eeb384-53ec-41c6-be9f-476ad3ccfe70 service nova] Enqueued Resource ID: 61979333-84a6-4e8a-89ac-c631d82b826f with Priority: HIGHEST for action port [ 647.938343] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 647.938343] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 647.938343] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61979333-84a6-4e8a-89ac-c631d82b826f with Priority: HIGHEST for action port [ 647.938343] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.938343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.939305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.940558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.940558] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-61979333-84a6-4e8a-89ac-c631d82b826f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.940558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.940558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.940558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.940558] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61979333-84a6-4e8a-89ac-c631d82b826f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.955321] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: SUCCESS [ 647.955859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.977374] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c78203ee-b32f-401b-9764-682ada8423c6 in Status: SUCCESS [ 647.977374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.008572] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.008729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.008811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.009053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.009184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.009481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.009665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.009771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.009978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.010077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.010173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 648.044076] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 648.044342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.044611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.044983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.045901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.045901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.045901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.045901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.045901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.045901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.046503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.046693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.047449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.047449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.047449] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.047449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.047449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.047449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.047932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.047932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.047932] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.049564] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.049678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.049742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.049895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.050618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.064344] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 648.064344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.064344] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 648.064344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.064344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.064344] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.064344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.064344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.064344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.064992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.065426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.065716] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.246023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.246023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.246023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.246023] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.247695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.247848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.248451] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.248451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.248451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.248703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.248796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.248997] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.443808] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61979333-84a6-4e8a-89ac-c631d82b826f with status ACTIVE [ 648.445280] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.445280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.445280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.445546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.445546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.446486] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.446486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.446486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.446486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.446486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.446486] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.447130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.447408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.447629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.447762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.447862] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61979333-84a6-4e8a-89ac-c631d82b826f is going to be updated. [ 648.470856] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.471030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.471107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.471320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.471456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.471620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61979333-84a6-4e8a-89ac-c631d82b826f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.552943] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8: rpc.has_security_group_logging(os_id): False [ 648.568889] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.579848] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.579848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.579848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.580317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.580550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.581364] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.581510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.581578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.581778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.581863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.582794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.582906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.582976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.583156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.583241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.583481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.585866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.585866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.585866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.585866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.585866] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 648.668069] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.668069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.668069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.668069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.668069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.683726] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 648.751190] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.751399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.751904] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.071987] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20dddc20-b178-4d49-afa2-bbeaf4630ee9: rpc.has_security_group_logging(os_id): False [ 649.094239] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.094239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.094239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.095259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.095259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.095259] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.095259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.095259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.095259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.096478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.099185] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be updated. [ 649.182868] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.183055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.183134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.183353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.183510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.193125] env[65107]: INFO networking_nsxv3.common.synchronization [req-2aa0ccad-d07a-4b46-855c-c1dbdb18b351 req-39a653be-9717-4ad1-bd30-6221aabd1824 tempest-ServersAdminNegativeTestJSON-1455848825 tempest-ServersAdminNegativeTestJSON-1455848825-project-member] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 649.194158] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 649.195933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.195933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.195933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.195933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.195933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.195933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.195933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.195933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.196390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.196390] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.199617] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: IN_PROGRESS for 2s [ 649.256514] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.676145] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.676824] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.676958] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.677361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.677660] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.677827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.677938] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.678177] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.678518] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.678809] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.678883] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.679029] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.679762] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.679762] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.679762] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.679762] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.699605] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.707078] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.707078] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.707078] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.707078] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.707078] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-ed20c05f-9162-4b45-ae91-e97b9b5ff701 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.707078] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.707078] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.707078] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.707078] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed20c05f-9162-4b45-ae91-e97b9b5ff701',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.759094] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.760086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.760568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.763315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.763315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.763315] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 649.801027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.801027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.801027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.801027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.801027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.814690] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 649.843220] env[65107]: INFO networking_nsxv3.common.synchronization [req-2cdf71d0-988c-4552-abad-1e35203f152a req-25667fcf-4241-4751-a329-cf18f99e69da tempest-ImagesNegativeTestJSON-1342465760 tempest-ImagesNegativeTestJSON-1342465760-project-member] Enqueued Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_members [ 649.843891] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e382ab2d-f671-4098-ac12-6a8786603007 with Priority: HIGHEST for action security_group_members [ 649.844584] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e382ab2d-f671-4098-ac12-6a8786603007 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.844990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.844990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.848305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.848512] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.848653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.848653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.848898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.848987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.849107] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e382ab2d-f671-4098-ac12-6a8786603007',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.018905] env[65107]: INFO networking_nsxv3.common.synchronization [req-48560289-689d-468e-a8f5-8ce9ac80c526 req-610f2068-97f8-4c42-a2b1-3522eef8ac73 tempest-SecurityGroupRulesNegativeTestJSON-1078192813 tempest-SecurityGroupRulesNegativeTestJSON-1078192813-project-member] Enqueued Resource ID: 2176f093-29ad-4dbe-b768-b8e3bfe9bfad with Priority: HIGHEST for action security_group_rules [ 650.019480] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2176f093-29ad-4dbe-b768-b8e3bfe9bfad with Priority: HIGHEST for action security_group_rules [ 650.022425] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.022681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.022765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.023163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.023259] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2176f093-29ad-4dbe-b768-b8e3bfe9bfad',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.083466] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 650.083466] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd deletion is rescheduled due to dependency. [ 650.083776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.083776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.083926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.084287] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.084287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.084505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.084505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.084590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.088047] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.202439] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.211486] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.211747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.211922] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.212682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.212682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.212901] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port ed20c05f-9162-4b45-ae91-e97b9b5ff701 not found, creating... [ 650.213274] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.213534] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.213791] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.214132] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.214348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.214791] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.215063] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.215253] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.215659] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.215934] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.216238] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: ed20c05f-9162-4b45-ae91-e97b9b5ff701 is going to be created. [ 650.247942] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.248299] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.248486] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.248775] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.249043] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.249316] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.353037] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.353037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.353037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.353037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.353331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.353331] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.353476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.353476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.353599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.353677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.353768] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e382ab2d-f671-4098-ac12-6a8786603007 is going to be updated. [ 650.425438] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.426120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.426272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.426528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.426712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.438139] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e382ab2d-f671-4098-ac12-6a8786603007 in Status: IN_PROGRESS for 2s [ 650.555883] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.557508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.557508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.557508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.557508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.557508] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2176f093-29ad-4dbe-b768-b8e3bfe9bfad already deleted. [ 650.557508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.590950] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.591174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.591272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.591481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.591577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.591775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.592203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.592340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.592496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.592572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.593260] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 650.624125] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.624335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.624335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.624568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.624721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.634958] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 650.650456] env[65107]: INFO networking_nsxv3.common.synchronization [req-306dd4b4-c2bb-41a5-a738-1b98bc08ac72 req-f5c5df39-36e8-42f9-bcc2-ae1e39573414 tempest-ServerDiagnosticsNegativeTest-1172872999 tempest-ServerDiagnosticsNegativeTest-1172872999-project-member] Enqueued Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_members [ 650.651407] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGHEST for action security_group_members [ 650.651824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.652039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.652127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.652387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.652576] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.652712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.652787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.652974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.653079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.653188] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.700060] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 650.700312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.701128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.701320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.701425] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.706923] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.706923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.706923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.706923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.706923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.706923] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be updated. [ 650.754504] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.754504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.754504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.754504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.754504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.767747] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: IN_PROGRESS for 2s [ 651.021468] env[65107]: INFO networking_nsxv3.common.synchronization [req-2aa0ccad-d07a-4b46-855c-c1dbdb18b351 req-dd2ce273-2591-4f33-835a-c14b5dcb584b service nova] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_rules [ 651.021908] env[65107]: INFO networking_nsxv3.common.synchronization [req-2aa0ccad-d07a-4b46-855c-c1dbdb18b351 req-dd2ce273-2591-4f33-835a-c14b5dcb584b service nova] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 651.021908] env[65107]: INFO networking_nsxv3.common.synchronization [req-2aa0ccad-d07a-4b46-855c-c1dbdb18b351 req-dd2ce273-2591-4f33-835a-c14b5dcb584b service nova] Enqueued Resource ID: ed20c05f-9162-4b45-ae91-e97b9b5ff701 with Priority: HIGHEST for action port [ 651.022128] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_rules [ 651.022285] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 651.022384] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed20c05f-9162-4b45-ae91-e97b9b5ff701 with Priority: HIGHEST for action port [ 651.023341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.023481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.023549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.023746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.023857] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.024678] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.024814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.024991] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed20c05f-9162-4b45-ae91-e97b9b5ff701 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.025083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.025119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.025287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.025359] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed20c05f-9162-4b45-ae91-e97b9b5ff701',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.156711] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.157023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.157023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.157194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.157249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.157462] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.157558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.157623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.157775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.157853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.157936] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 is going to be updated. [ 651.189735] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.189851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.189936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.190218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.190372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.202244] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 in Status: IN_PROGRESS for 2s [ 651.207487] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.207487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.207487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.207707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.208199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.208199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.208199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.208199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.208426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.208426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.208490] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.212926] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 651.213343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.504556] env[65107]: INFO networking_nsxv3.common.synchronization [req-50e7c31a-0bf8-484f-aead-4d4e6988e2cc req-e0bf6de7-bb26-46c1-a886-e6b58d70fa2c tempest-DeleteServersAdminTestJSON-30165657 tempest-DeleteServersAdminTestJSON-30165657-project-member] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 651.505207] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 651.505554] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.505900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.505900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.506231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.506756] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.506756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.506926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.507018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.507167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.507250] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.530657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.530762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.530965] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed20c05f-9162-4b45-ae91-e97b9b5ff701 with status ACTIVE [ 651.531164] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.531273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.531341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.531628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.531764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.531945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.532098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.532178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.532501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.532501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.532657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.532774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.532870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.533488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.533751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.534069] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed20c05f-9162-4b45-ae91-e97b9b5ff701 is going to be updated. [ 651.562288] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.562288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.562288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.562288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.562288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.562561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed20c05f-9162-4b45-ae91-e97b9b5ff701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.710532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.712221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.712365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.712556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.712759] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.712934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.712934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.714066] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.714066] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.714066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.714628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.714628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.714628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.714628] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.827283] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 651.827570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.827745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.827986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.828205] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.828356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.828433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.828604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.828684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.828778] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.945684] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.946087] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.946087] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.946272] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.946640] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.946640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.946790] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.946922] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.947069] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.947258] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.947524] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.947524] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.947629] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.947780] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.947988] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.948790] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.972205] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.973031] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.973031] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.973031] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.973571] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-012009a9-8129-4c86-93ab-548e8ce00665 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.974396] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.974396] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.974536] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.974840] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('012009a9-8129-4c86-93ab-548e8ce00665',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.011236] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.011514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.011598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.011818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.012157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.012238] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.012375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.012465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.012675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.012788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.012911] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be updated. [ 652.048294] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.048498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.048561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.049067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.049067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.060857] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: IN_PROGRESS for 2s [ 652.220425] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8: rpc.has_security_group_logging(os_id): False [ 652.243826] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.243998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.244114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.244350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.244426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.244566] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.244698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.244771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.244940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.245027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.245237] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.245349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.245401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.245665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.245665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.245843] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.245949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.246045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.246204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.246285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.246986] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 652.327104] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.327104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.327104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.327104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.327104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.332260] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.375985] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 652.452216] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e382ab2d-f671-4098-ac12-6a8786603007 in Status: SUCCESS [ 652.452216] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e382ab2d-f671-4098-ac12-6a8786603007 deletion is rescheduled due to dependency. [ 652.452216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e382ab2d-f671-4098-ac12-6a8786603007" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.480084] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.480084] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 012009a9-8129-4c86-93ab-548e8ce00665 not found, creating... [ 652.480084] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.480084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.480619] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.480619] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.480619] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.480619] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.481394] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.481782] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 012009a9-8129-4c86-93ab-548e8ce00665 is going to be created. [ 652.506054] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.506054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.506054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.506054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.506054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.506054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.648683] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 652.648683] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd deletion is rescheduled due to dependency. [ 652.648942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.781280] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: SUCCESS [ 652.781522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.781703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.781921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.782492] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.782492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.782492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.782492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.782777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.782777] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.835405] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.213559] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 in Status: SUCCESS [ 653.213769] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 deletion is rescheduled due to dependency. [ 653.213920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.218442] env[65107]: INFO networking_nsxv3.common.synchronization [req-50e7c31a-0bf8-484f-aead-4d4e6988e2cc req-a7e153c4-1168-4dd9-ba2e-d4f339352609 service nova] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_rules [ 653.218631] env[65107]: INFO networking_nsxv3.common.synchronization [req-50e7c31a-0bf8-484f-aead-4d4e6988e2cc req-a7e153c4-1168-4dd9-ba2e-d4f339352609 service nova] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 653.218789] env[65107]: INFO networking_nsxv3.common.synchronization [req-50e7c31a-0bf8-484f-aead-4d4e6988e2cc req-a7e153c4-1168-4dd9-ba2e-d4f339352609 service nova] Enqueued Resource ID: 012009a9-8129-4c86-93ab-548e8ce00665 with Priority: HIGHEST for action port [ 653.219479] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_rules [ 653.220302] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 653.220302] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012009a9-8129-4c86-93ab-548e8ce00665 with Priority: HIGHEST for action port [ 653.222757] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.223065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.223065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.223250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.223349] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.224363] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.224500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.225090] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-012009a9-8129-4c86-93ab-548e8ce00665 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.225090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.225090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.225090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.225332] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('012009a9-8129-4c86-93ab-548e8ce00665',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.286528] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.338027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.340623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.340623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.340623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.340623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.340623] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 653.375387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.375387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.375387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.375387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.375624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.391033] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 653.726799] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.726939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.729340] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 012009a9-8129-4c86-93ab-548e8ce00665 with status ACTIVE [ 653.729839] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.729839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.729839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.730029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.730066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.730229] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.730324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.730390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.730546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.730624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.730806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.730898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.730958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.731108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.731182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.731267] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 012009a9-8129-4c86-93ab-548e8ce00665 is going to be updated. [ 653.754870] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.755102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.755143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.755365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.755496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.755656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-012009a9-8129-4c86-93ab-548e8ce00665" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.787733] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.073525] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: SUCCESS [ 654.073711] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd deletion is rescheduled due to dependency. [ 654.073834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.073992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.074299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.074522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.074647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.074762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.074885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.074969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.075326] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.259171] env[65107]: INFO networking_nsxv3.common.synchronization [req-fe4c81c3-94ae-4a04-80c8-8a8e82db705e req-5e8ff31d-5bee-4676-8006-5072af3052e1 tempest-SecurityGroupRulesNegativeTestJSON-1078192813 tempest-SecurityGroupRulesNegativeTestJSON-1078192813-project-member] Enqueued Resource ID: 2176f093-29ad-4dbe-b768-b8e3bfe9bfad with Priority: HIGHEST for action security_group_rules [ 654.260928] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2176f093-29ad-4dbe-b768-b8e3bfe9bfad with Priority: HIGHEST for action security_group_rules [ 654.263230] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.263230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.263230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.263230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.263230] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2176f093-29ad-4dbe-b768-b8e3bfe9bfad',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.292032] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.292240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.292476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.292563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.292665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.292825] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be updated. [ 654.328152] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.328487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.328575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.329254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.329254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.349426] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: IN_PROGRESS for 2s [ 654.396759] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 654.396759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.579230] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.619778] env[65107]: INFO networking_nsxv3.common.synchronization [req-036f85c8-3c98-4272-88df-9651b3195828 req-74da15e5-94fb-4a5c-a192-4cef5ee9abf7 tempest-ListImageFiltersTestJSON-1797771645 tempest-ListImageFiltersTestJSON-1797771645-project-member] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 654.620389] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 654.620705] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.620830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.620897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.621721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.621721] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.621721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.621721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.621947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.621947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.621947] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.788098] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.788397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.788453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.789929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.789929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.789929] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2176f093-29ad-4dbe-b768-b8e3bfe9bfad already deleted. [ 654.789929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2176f093-29ad-4dbe-b768-b8e3bfe9bfad" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.235715] env[65107]: INFO networking_nsxv3.common.synchronization [None req-61c3bbfc-fd72-4e30-b11f-bc70325c6ec9 None None] Enqueued Resource ID: 4e58fdd6-5d90-428e-99ba-777d3d27ed33 with Priority: HIGHEST for action port [ 655.237258] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.239221] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.239221] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.239221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.239721] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a already deleted. [ 655.239721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.240022] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e58fdd6-5d90-428e-99ba-777d3d27ed33 with Priority: HIGHEST for action port [ 655.240983] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.241174] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.241287] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.241676] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.241744] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.241870] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.241978] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.242272] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.242465] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.242739] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.242894] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.243056] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.243213] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.243686] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.243686] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.243686] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.246418] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e58fdd6-5d90-428e-99ba-777d3d27ed33 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.246610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e58fdd6-5d90-428e-99ba-777d3d27ed33" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.247109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e58fdd6-5d90-428e-99ba-777d3d27ed33" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.247109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e58fdd6-5d90-428e-99ba-777d3d27ed33" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.247109] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e58fdd6-5d90-428e-99ba-777d3d27ed33',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.285953] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.286476] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.286476] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.286642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.287118] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-d81e7816-91de-4a59-a1e6-3801e27a56fb taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.287330] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.287383] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.287730] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.287871] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81e7816-91de-4a59-a1e6-3801e27a56fb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.401895] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 655.401895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.401895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.402162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.402200] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.402327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.402395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.402557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.402745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.402745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.402992] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.402992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.402992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.403169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.403276] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.403380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.403440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.404051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.404051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.404176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.404236] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.746484] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.746673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.746740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.746967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.747097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.747228] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be updated. [ 655.750172] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e58fdd6-5d90-428e-99ba-777d3d27ed33 [ 655.750403] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.750545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.751118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.751118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.751118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.751118] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e58fdd6-5d90-428e-99ba-777d3d27ed33 already deleted. [ 655.751426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e58fdd6-5d90-428e-99ba-777d3d27ed33" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.777976] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.778173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.778173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.778690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.778690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.790336] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: IN_PROGRESS for 2s [ 655.791253] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.791413] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.791515] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.791792] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.792049] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.792209] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port d81e7816-91de-4a59-a1e6-3801e27a56fb not found, creating... [ 655.792461] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.792619] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.792728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.792963] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.793109] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.793382] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.793527] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.793689] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.793967] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.794152] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794295] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: d81e7816-91de-4a59-a1e6-3801e27a56fb is going to be created. [ 655.814483] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.814811] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.814968] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.815253] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.815508] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.815746] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.909093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d43e6dbc-45c8-476b-af04-082906b1ad4d: rpc.has_security_group_logging(os_id): False [ 655.932543] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.932784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.932833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.933042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.933142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.933540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.933683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.933778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.933985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.934103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.934339] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.934473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.934535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.934715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.934800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.935038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.935157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.935230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.935398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.935484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.935586] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be created. [ 656.036561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.036561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.036561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.036783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.037957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.057490] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 656.365032] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: SUCCESS [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.365032] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.365032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.365961] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.581891] env[65107]: INFO networking_nsxv3.common.synchronization [req-036f85c8-3c98-4272-88df-9651b3195828 req-15fced6d-067f-49b6-8672-0db176d57ea7 service nova] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_rules [ 656.581891] env[65107]: INFO networking_nsxv3.common.synchronization [req-036f85c8-3c98-4272-88df-9651b3195828 req-15fced6d-067f-49b6-8672-0db176d57ea7 service nova] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 656.581891] env[65107]: INFO networking_nsxv3.common.synchronization [req-036f85c8-3c98-4272-88df-9651b3195828 req-15fced6d-067f-49b6-8672-0db176d57ea7 service nova] Enqueued Resource ID: d81e7816-91de-4a59-a1e6-3801e27a56fb with Priority: HIGHEST for action port [ 656.581891] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_rules [ 656.582119] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 656.582759] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81e7816-91de-4a59-a1e6-3801e27a56fb with Priority: HIGHEST for action port [ 656.583695] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.583695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.583695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.583695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.583695] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.589037] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.589037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.589037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.589250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.589543] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.589603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.589830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.591185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.591185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.591185] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.591476] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d81e7816-91de-4a59-a1e6-3801e27a56fb taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.591600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.591600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.591736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.592043] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81e7816-91de-4a59-a1e6-3801e27a56fb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.869745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.869945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.870134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.870335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.871313] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.871313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.871313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.874555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.874681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.874842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.875024] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.875193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.875370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.875569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.875663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.875807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.875898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.876201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.876345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.876393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.876609] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.094131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.094639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.094738] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.095835] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d81e7816-91de-4a59-a1e6-3801e27a56fb with status ACTIVE [ 657.096059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.096212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.096304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.096514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.096599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.096787] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.096879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.096938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.098015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.098269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.098548] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.099055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.099196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.102872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.102872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.102872] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d81e7816-91de-4a59-a1e6-3801e27a56fb is going to be updated. [ 657.129982] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.130207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.130314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.130569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.130709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.130871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d81e7816-91de-4a59-a1e6-3801e27a56fb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.382838] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 562b8388-027e-4f71-8ef8-2da4162f2318: rpc.has_security_group_logging(os_id): False [ 657.405475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.405741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.405741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.405960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.406210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.406480] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.406584] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.406653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.406818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.406897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.407120] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.407224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.407281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.407418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.407489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.407664] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.407759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.407814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.407929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.407998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.408091] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be updated. [ 657.481086] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.481399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.481399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.482034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.482034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.502902] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: IN_PROGRESS for 2s [ 657.604649] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.805628] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: SUCCESS [ 657.809131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.810220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.810220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.810220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.810220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.810220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.810220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.810864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.810864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.810864] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.015830] env[65107]: INFO networking_nsxv3.common.synchronization [None req-116d1c40-a2a1-44b0-93a2-b49f7ba5d950 None None] Enqueued Resource ID: 97413e5d-5c86-494c-8a26-bdc2bc8f686e with Priority: HIGHEST for action port [ 658.018463] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97413e5d-5c86-494c-8a26-bdc2bc8f686e with Priority: HIGHEST for action port [ 658.018463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-97413e5d-5c86-494c-8a26-bdc2bc8f686e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.018808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97413e5d-5c86-494c-8a26-bdc2bc8f686e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.018808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97413e5d-5c86-494c-8a26-bdc2bc8f686e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.018910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97413e5d-5c86-494c-8a26-bdc2bc8f686e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.019180] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97413e5d-5c86-494c-8a26-bdc2bc8f686e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.070044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 658.070286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.070464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.070717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.070799] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.108371] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.108371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.108371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.108371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.108371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.108371] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be created. [ 658.134114] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.134267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.134335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.134535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.134699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.148724] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: UNINITIALIZED for 2s [ 658.205954] env[65107]: INFO networking_nsxv3.common.synchronization [None req-c71db9bf-040d-4798-b508-454b8f5a76e4 None None] Enqueued Resource ID: 11d33ba2-5203-478c-af46-3bbd175eb373 with Priority: HIGHEST for action port [ 658.206225] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d33ba2-5203-478c-af46-3bbd175eb373 with Priority: HIGHEST for action port [ 658.207373] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-11d33ba2-5203-478c-af46-3bbd175eb373 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.207373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11d33ba2-5203-478c-af46-3bbd175eb373" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.207373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11d33ba2-5203-478c-af46-3bbd175eb373" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.207373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11d33ba2-5203-478c-af46-3bbd175eb373" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.207373] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11d33ba2-5203-478c-af46-3bbd175eb373',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.313514] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.313853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.314027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.314178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.315377] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.315377] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.315377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.315991] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.315991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.315991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.315991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.315991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.315991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.316337] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.522168] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97413e5d-5c86-494c-8a26-bdc2bc8f686e [ 658.524071] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.524071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.524071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.524071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.524071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.524071] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97413e5d-5c86-494c-8a26-bdc2bc8f686e already deleted. [ 658.524071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97413e5d-5c86-494c-8a26-bdc2bc8f686e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.574393] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.574833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.575095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.575491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.580972] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.580972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.580972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.580972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.580972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.580972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.580972] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.711210] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11d33ba2-5203-478c-af46-3bbd175eb373 [ 658.711210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.711210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.711210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.711210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.711210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.711210] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11d33ba2-5203-478c-af46-3bbd175eb373 already deleted. [ 658.711210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11d33ba2-5203-478c-af46-3bbd175eb373" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.822847] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 001132af-7c6a-44dd-97d6-1576257d23bd: rpc.has_security_group_logging(os_id): False [ 658.846952] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.848827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.848956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.849355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.849355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.851957] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.851957] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.851957] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.851957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.852819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.852819] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be updated. [ 658.938267] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.938502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.938584] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.938887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.942125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.964059] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: IN_PROGRESS for 2s [ 659.083210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.083210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.083210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.083210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.084297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.084297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.084297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.084898] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.084898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.084898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.084898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.084898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.084898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.084898] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.532512] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: SUCCESS [ 659.532914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.589660] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d43e6dbc-45c8-476b-af04-082906b1ad4d: rpc.has_security_group_logging(os_id): False [ 659.613836] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.613836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.613836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.614117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.614117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.614301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.614438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.614480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.614658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.614746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.614945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.615094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.615167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.615368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.615504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.615731] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.615843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.615904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.616836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.616950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.617060] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 659.636361] env[65107]: INFO networking_nsxv3.common.synchronization [req-a3eda796-b7e3-44bc-b909-4186104ccd83 req-b3bffb44-9674-42c3-944b-f813b1b8a9cc tempest-ListImageFiltersTestJSON-1797771645 tempest-ListImageFiltersTestJSON-1797771645-project-member] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 659.637775] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 659.637775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.637775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.692310] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.692477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.692589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.692737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.692871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.710923] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 660.134034] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.134264] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.134264] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.134501] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.134745] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.136495] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.136803] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.137100] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.137248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.137577] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.137577] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.137750] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.137750] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.137868] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.138288] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.138523] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.162244] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.162506] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.162689] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.162858] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.163292] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.163530] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.164160] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.164570] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.166072] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc14ae0-3a1d-4d4f-a45a-d1e657feaede',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.169505] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: SUCCESS [ 660.170185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.170412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.170718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.171310] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.171310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.171310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.171464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.172114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.172114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.172114] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.172955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.173215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.173395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.173504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.173572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.173712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.173864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.173949] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.675119] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.675119] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.675119] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.676432] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.676432] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.676432] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port abc14ae0-3a1d-4d4f-a45a-d1e657feaede not found, creating... [ 660.676432] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.676432] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.676432] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.676821] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.676958] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.677887] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.678159] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.678348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.678647] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.682040] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.682040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: abc14ae0-3a1d-4d4f-a45a-d1e657feaede is going to be created. [ 660.683089] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.683089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.683089] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.714284] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.714572] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.714732] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.715049] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.715681] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.715775] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.983068] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: SUCCESS [ 660.983811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.185920] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.469340] env[65107]: INFO networking_nsxv3.common.synchronization [None req-ed7af35d-0ac6-4f1c-bfe0-dd4a62b4da44 None None] Enqueued Resource ID: 27222940-66e2-4473-8ebd-23062da13f58 with Priority: HIGHEST for action port [ 661.469992] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27222940-66e2-4473-8ebd-23062da13f58 with Priority: HIGHEST for action port [ 661.470320] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-27222940-66e2-4473-8ebd-23062da13f58 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.470799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27222940-66e2-4473-8ebd-23062da13f58" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.470902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27222940-66e2-4473-8ebd-23062da13f58" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.471255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27222940-66e2-4473-8ebd-23062da13f58" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.471427] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27222940-66e2-4473-8ebd-23062da13f58',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.524080] env[65107]: INFO networking_nsxv3.common.synchronization [req-a3eda796-b7e3-44bc-b909-4186104ccd83 req-9b776dd6-e882-401f-bcae-ae7019e6b7b1 service nova] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_rules [ 661.524284] env[65107]: INFO networking_nsxv3.common.synchronization [req-a3eda796-b7e3-44bc-b909-4186104ccd83 req-9b776dd6-e882-401f-bcae-ae7019e6b7b1 service nova] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 661.524392] env[65107]: INFO networking_nsxv3.common.synchronization [req-a3eda796-b7e3-44bc-b909-4186104ccd83 req-9b776dd6-e882-401f-bcae-ae7019e6b7b1 service nova] Enqueued Resource ID: abc14ae0-3a1d-4d4f-a45a-d1e657feaede with Priority: HIGHEST for action port [ 661.525147] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_rules [ 661.525295] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 661.525438] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc14ae0-3a1d-4d4f-a45a-d1e657feaede with Priority: HIGHEST for action port [ 661.525777] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.525892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.526226] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.526325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.526508] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.526630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.526693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.526879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.527019] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc14ae0-3a1d-4d4f-a45a-d1e657feaede',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.692306] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.692306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.692306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.692306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.692306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.692306] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be updated. [ 661.726038] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 661.727135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.729957] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.730739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.730739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.730739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.730739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.744556] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: IN_PROGRESS for 2s [ 661.973385] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27222940-66e2-4473-8ebd-23062da13f58 [ 661.974361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.974361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.974361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.974361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.974361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.974361] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27222940-66e2-4473-8ebd-23062da13f58 already deleted. [ 661.974361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27222940-66e2-4473-8ebd-23062da13f58" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.018122] env[65107]: INFO networking_nsxv3.common.synchronization [req-f4f01766-fe36-4b0a-bd34-85e80522059b req-53d96506-d9cb-435d-a8a5-47985b62b842 tempest-FloatingIPsAssociationTestJSON-90781303 tempest-FloatingIPsAssociationTestJSON-90781303-project-member] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 662.018122] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 662.018122] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.018326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.018904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.019692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.020274] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.020470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.020554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.020958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.020958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.021072] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.029083] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abc14ae0-3a1d-4d4f-a45a-d1e657feaede with status ACTIVE [ 662.029321] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.029457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.029566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.031030] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.031030] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.031030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.031030] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abc14ae0-3a1d-4d4f-a45a-d1e657feaede is going to be updated. [ 662.058495] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.058676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.058676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.058900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.059170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.059362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abc14ae0-3a1d-4d4f-a45a-d1e657feaede" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.431662] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e83e8aa7-5a13-4274-a7fd-8a718db70035 None None] Enqueued Resource ID: 4b92526e-a0ee-49e5-95fa-2807ec342c57 with Priority: HIGHEST for action port [ 662.432331] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b92526e-a0ee-49e5-95fa-2807ec342c57 with Priority: HIGHEST for action port [ 662.433039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b92526e-a0ee-49e5-95fa-2807ec342c57 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.433161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b92526e-a0ee-49e5-95fa-2807ec342c57" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.433226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b92526e-a0ee-49e5-95fa-2807ec342c57" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.433527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b92526e-a0ee-49e5-95fa-2807ec342c57" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.433609] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b92526e-a0ee-49e5-95fa-2807ec342c57',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.488332] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.488332] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.488332] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.488642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.489179] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.489460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.489662] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.490029] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.490263] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.490575] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.490751] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.490923] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.491108] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.491322] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.491446] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.491650] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.514123] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.514325] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.514529] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.514696] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.515153] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-7d85f930-8843-4283-9feb-53fcdd989b28 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.515279] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.515337] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.515707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.515852] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d85f930-8843-4283-9feb-53fcdd989b28',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.523854] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.523942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.523990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.524572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.524572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.524572] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.524572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.524826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.524826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.524826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.524928] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 already deleted. [ 662.524986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.936394] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b92526e-a0ee-49e5-95fa-2807ec342c57 [ 662.938128] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.938128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.938128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.938128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.939084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.939084] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b92526e-a0ee-49e5-95fa-2807ec342c57 already deleted. [ 662.939084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b92526e-a0ee-49e5-95fa-2807ec342c57" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.019605] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.026134] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 7d85f930-8843-4283-9feb-53fcdd989b28 not found, creating... [ 663.026134] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.026134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.027494] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.027907] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.028222] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.028661] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.029019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.031020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 7d85f930-8843-4283-9feb-53fcdd989b28 is going to be created. [ 663.054281] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.054281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.054281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.054281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.054281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.054281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.758074] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: SUCCESS [ 663.758074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.758074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.758074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.758074] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.758074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.758074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.759354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.759354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.759354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.759354] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.759668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.759668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.759668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.759783] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.759963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.759963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.760133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.760176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.760264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.761612] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.761612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.761612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.761612] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.761953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.761953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.761953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.762061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.762193] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.801031] env[65107]: INFO networking_nsxv3.common.synchronization [req-f4f01766-fe36-4b0a-bd34-85e80522059b req-4bea9413-eb29-4e36-b8c7-717be47e0505 service nova] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_rules [ 663.801163] env[65107]: INFO networking_nsxv3.common.synchronization [req-f4f01766-fe36-4b0a-bd34-85e80522059b req-4bea9413-eb29-4e36-b8c7-717be47e0505 service nova] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 663.801254] env[65107]: INFO networking_nsxv3.common.synchronization [req-f4f01766-fe36-4b0a-bd34-85e80522059b req-4bea9413-eb29-4e36-b8c7-717be47e0505 service nova] Enqueued Resource ID: 7d85f930-8843-4283-9feb-53fcdd989b28 with Priority: HIGHEST for action port [ 663.802139] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_rules [ 663.802284] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 663.802381] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d85f930-8843-4283-9feb-53fcdd989b28 with Priority: HIGHEST for action port [ 663.802691] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.802878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.802878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.803133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.803231] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.804131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.804303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.804383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.804563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.805119] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.805119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.805119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.805119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.805119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.805383] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.807309] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d85f930-8843-4283-9feb-53fcdd989b28 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.807309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.807309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.807309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.807309] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d85f930-8843-4283-9feb-53fcdd989b28',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.264410] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed87eef5-439b-4752-b6cf-ead13a28e49a: rpc.has_security_group_logging(os_id): False [ 664.267414] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.287544] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.287872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.288265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.288265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.288517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.289039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.289229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.289351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.289598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.289733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.290009] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.290168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.290257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.290462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.290618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.290946] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.292596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.292680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.292836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.292979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.293038] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be created. [ 664.308181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.308403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.308757] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.309889] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d85f930-8843-4283-9feb-53fcdd989b28 with status ACTIVE [ 664.310163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.310318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.310404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.310656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.313201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.313614] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.313790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.313790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.314114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.314222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.314432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.314535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.314609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.314767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.314844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.314932] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d85f930-8843-4283-9feb-53fcdd989b28 is going to be updated. [ 664.340525] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.340715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.340798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.343353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.343630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.343956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d85f930-8843-4283-9feb-53fcdd989b28" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.364905] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.365122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.365194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.365519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.365718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.380859] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: IN_PROGRESS for 2s [ 664.504796] env[65107]: INFO networking_nsxv3.common.synchronization [req-e9dceb7b-c940-4652-bb42-944582c3d1e1 req-c45c2111-2c17-4000-9694-cd803301f78a tempest-VolumesAdminNegativeTest-419586370 tempest-VolumesAdminNegativeTest-419586370-project-member] Enqueued Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_members [ 664.507935] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_members [ 664.508050] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.508163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.508232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.508577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.508835] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.508979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.509059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.509420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.509420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.509592] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.769534] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.818252] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.902152] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.902354] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-507" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.902504] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-507" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.902808] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-507" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.903076] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.903275] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.903436] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.903648] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.903742] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.903917] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.904039] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.904192] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.904377] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.904377] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.904495] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.904549] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.926603] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.926817] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.927066] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.927230] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-507" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.927659] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.927793] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.927860] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.928208] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.928416] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.013765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.013923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.013997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.014235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.014326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.014551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.014639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.014676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.015572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.015572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.015572] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60b9686-7de1-476f-8126-57c150974fec already deleted. [ 665.015572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.273068] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.273068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.273068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.273068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.273068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.273817] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be updated. [ 665.311029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.311316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.311316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.311544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.311651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.321478] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.321728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.321728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.321975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.322099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.322227] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be created. [ 665.323932] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: IN_PROGRESS for 2s [ 665.385479] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.385763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.385763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.386095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.386095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.398866] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: UNINITIALIZED for 2s [ 665.434023] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.434023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae not found, creating... [ 665.434023] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.434023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.434650] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.434801] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.435373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.435878] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.436160] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.436510] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae is going to be created. [ 665.459545] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.459775] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.459775] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.459993] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.460257] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.460479] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.681108] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7204ae71-b0a1-4d69-8031-0c8f0c89cc56 None None] Enqueued Resource ID: ba903467-0346-48ac-837f-875cfcd28952 with Priority: HIGHEST for action port [ 665.685860] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba903467-0346-48ac-837f-875cfcd28952 with Priority: HIGHEST for action port [ 665.687226] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba903467-0346-48ac-837f-875cfcd28952 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.687391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba903467-0346-48ac-837f-875cfcd28952" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.687482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba903467-0346-48ac-837f-875cfcd28952" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.687812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba903467-0346-48ac-837f-875cfcd28952" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.688072] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba903467-0346-48ac-837f-875cfcd28952',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.191704] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba903467-0346-48ac-837f-875cfcd28952 [ 666.191893] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.192065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.192609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.192609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.192609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.192798] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba903467-0346-48ac-837f-875cfcd28952 already deleted. [ 666.192900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba903467-0346-48ac-837f-875cfcd28952" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.402420] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: SUCCESS [ 666.404556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.405133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.406032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.406032] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.460705] env[65107]: INFO networking_nsxv3.common.synchronization [req-e9dceb7b-c940-4652-bb42-944582c3d1e1 req-7a24d824-4c82-4e3a-8534-4b87c5b34673 service nova] Enqueued Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_rules [ 666.460705] env[65107]: INFO networking_nsxv3.common.synchronization [req-e9dceb7b-c940-4652-bb42-944582c3d1e1 req-7a24d824-4c82-4e3a-8534-4b87c5b34673 service nova] Enqueued Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_members [ 666.461884] env[65107]: INFO networking_nsxv3.common.synchronization [req-e9dceb7b-c940-4652-bb42-944582c3d1e1 req-7a24d824-4c82-4e3a-8534-4b87c5b34673 service nova] Enqueued Resource ID: 4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae with Priority: HIGHEST for action port [ 666.461884] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_rules [ 666.462109] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_members [ 666.462273] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae with Priority: HIGHEST for action port [ 666.462606] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.462768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.462904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.463213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.463328] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.467445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.467445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.467445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.467445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.467445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.467445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.467445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.467445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.467445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.467801] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.469522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.469828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.469828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.470085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.470193] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.909595] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.909820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.967265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.967265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.970894] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.975578] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae with status ACTIVE [ 666.975578] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.975578] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.975578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.975578] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.976212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.976212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.976212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.976212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.976212] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae is going to be updated. [ 667.002333] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.002518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.002593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.002812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.002960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.003175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b7ce5d6-eb88-4e03-b7bc-64c3aa4615ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.336808] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: SUCCESS [ 667.337103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.337333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.337454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.338143] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.338143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.338143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.338143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.338143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.338511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.338511] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.411213] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 667.411576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.411576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.411834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.412140] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.412243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.412243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.412437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.412593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.412648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.412735] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.473500] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.841548] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.841767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.841894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.842198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.842307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.842390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.842473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.842605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.842698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.842797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.842945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.843066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.843136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.843284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.843427] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.843514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.843573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.844033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.844033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.844033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.844210] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.915143] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.917033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.917033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.917499] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.917499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.917499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.917499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.918172] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.918172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.918172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.918385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.918793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.918793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.918793] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.975106] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.975886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.976274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.978207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.978366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.978579] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60b9686-7de1-476f-8126-57c150974fec is going to be created. [ 668.006547] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.006694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.006765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.006968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.007143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.020191] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60b9686-7de1-476f-8126-57c150974fec in Status: UNINITIALIZED for 2s [ 668.346362] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed87eef5-439b-4752-b6cf-ead13a28e49a: rpc.has_security_group_logging(os_id): False [ 668.364798] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.364984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.365061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.365234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.365331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.365557] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.365682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.365738] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.365851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.365928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.366150] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.366259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.366326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.366478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.366688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.366751] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.366819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.366879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.367043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.367121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.367215] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be updated. [ 668.424377] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6801a112-5684-487c-b713-b3fc340c09d5: rpc.has_security_group_logging(os_id): False [ 668.442674] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.442834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.442911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.443156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.443262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.443468] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.443570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.443833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.443833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.443955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.444088] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.444185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.444245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.444400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.444475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.444724] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.444846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.444909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.445084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.445176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.445426] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be created. [ 668.451238] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.451411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.451479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.451696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.451843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.463261] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: IN_PROGRESS for 2s [ 668.510585] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.510739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.510814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.511091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.511282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.530067] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 2s [ 670.030208] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60b9686-7de1-476f-8126-57c150974fec in Status: SUCCESS [ 670.030486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.030629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.031027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.031262] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.031394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.031462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.031839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.031839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.031839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.031839] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.264486] env[65107]: INFO networking_nsxv3.common.synchronization [None req-76ebdb96-2cf6-45f5-8b1f-1be9cccd76ad None None] Enqueued Resource ID: 5914ca55-5911-4246-bd35-eb7f324fc232 with Priority: HIGHEST for action port [ 670.265570] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5914ca55-5911-4246-bd35-eb7f324fc232 with Priority: HIGHEST for action port [ 670.265771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-5914ca55-5911-4246-bd35-eb7f324fc232 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.265895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5914ca55-5911-4246-bd35-eb7f324fc232" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.266186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5914ca55-5911-4246-bd35-eb7f324fc232" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.267123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5914ca55-5911-4246-bd35-eb7f324fc232" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.267123] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5914ca55-5911-4246-bd35-eb7f324fc232',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.481981] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: SUCCESS [ 670.482254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.537464] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.537685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.537685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.538373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.538373] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.538373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.538373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.538630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.538630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.538630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.538774] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.538861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.538919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.539067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.539825] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.539825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.539825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.539825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.539825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.539825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.539825] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.543034] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 670.543239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.712386] env[65107]: INFO networking_nsxv3.common.synchronization [req-e6e54474-0b97-4ddf-8452-47f33d19df1c req-28bfb67d-20ec-44fb-81b8-3799e68085f1 tempest-FloatingIPsAssociationNegativeTestJSON-668852265 tempest-FloatingIPsAssociationNegativeTestJSON-668852265-project-member] Enqueued Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_members [ 670.713402] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_members [ 670.713402] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.713645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.713645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.713823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.713990] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.714145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.714180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.714336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.714423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.714513] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.773040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5914ca55-5911-4246-bd35-eb7f324fc232 [ 670.773040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.773040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.773040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.773040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.773040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.773040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5914ca55-5911-4246-bd35-eb7f324fc232 already deleted. [ 670.773040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5914ca55-5911-4246-bd35-eb7f324fc232" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.042251] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c60b9686-7de1-476f-8126-57c150974fec: rpc.has_security_group_logging(os_id): False [ 671.072806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.072949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.073178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.073264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.073381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.073606] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.073710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.073773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.073931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.074017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.074198] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.074290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.074366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.074486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.075068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.075068] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.075068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.075068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.075068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.075332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.075332] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c60b9686-7de1-476f-8126-57c150974fec is going to be created. [ 671.136579] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.136579] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-257" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.136579] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-257" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.137159] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-257" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.137709] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.137954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.138054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.138482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.138482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.138804] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.138924] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.139141] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.139457] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.139643] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.139780] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.139970] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.154952] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.155236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.155310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.155548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.155767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.163570] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.163570] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.163570] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.163570] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-257" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.163957] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-8129f9a6-dd83-4203-8fe2-a945f50b6633 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.165060] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.165315] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.166305] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.166305] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8129f9a6-dd83-4203-8fe2-a945f50b6633',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.171476] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c60b9686-7de1-476f-8126-57c150974fec in Status: IN_PROGRESS for 2s [ 671.217467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.217467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.217605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.217739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.217810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.218055] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.218170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.218370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.218370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.218525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.218597] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a469b2f-9178-42b0-be36-f1370374e744 already deleted. [ 671.218711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.668646] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.668646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.668646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.669116] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.669116] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.669263] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 8129f9a6-dd83-4203-8fe2-a945f50b6633 not found, creating... [ 671.669552] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.669730] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.669861] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.670161] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.670298] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.670603] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.670844] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.671837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.671837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.671837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.671837] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 8129f9a6-dd83-4203-8fe2-a945f50b6633 is going to be created. [ 671.696795] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.697164] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.697213] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.697597] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.697793] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.698268] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.730187] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1118713d-e05e-4efc-b265-7466856d3864 None None] Enqueued Resource ID: faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8 with Priority: HIGHEST for action port [ 671.730187] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8 with Priority: HIGHEST for action port [ 671.730625] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.730919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.731105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.731448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.731683] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.235153] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8 [ 672.235153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.235153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.235153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.235153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.235153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.235153] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8 already deleted. [ 672.235153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faf65578-0d5d-4ab2-a7f4-e3c1e11cb4b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.531801] env[65107]: INFO networking_nsxv3.common.synchronization [req-e6e54474-0b97-4ddf-8452-47f33d19df1c req-f0fa2746-4e8d-4e8f-926f-df5e07787e8c service nova] Enqueued Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_rules [ 672.531994] env[65107]: INFO networking_nsxv3.common.synchronization [req-e6e54474-0b97-4ddf-8452-47f33d19df1c req-f0fa2746-4e8d-4e8f-926f-df5e07787e8c service nova] Enqueued Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_members [ 672.532107] env[65107]: INFO networking_nsxv3.common.synchronization [req-e6e54474-0b97-4ddf-8452-47f33d19df1c req-f0fa2746-4e8d-4e8f-926f-df5e07787e8c service nova] Enqueued Resource ID: 8129f9a6-dd83-4203-8fe2-a945f50b6633 with Priority: HIGHEST for action port [ 672.532737] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_rules [ 672.532870] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_members [ 672.533009] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8129f9a6-dd83-4203-8fe2-a945f50b6633 with Priority: HIGHEST for action port [ 672.533325] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.533454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.533526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.533788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.533866] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.535808] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.535966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.536052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.536244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.536397] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.536590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.536664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.536859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.537044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.537320] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.538453] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8129f9a6-dd83-4203-8fe2-a945f50b6633 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.538691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.538787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.538952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.539039] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8129f9a6-dd83-4203-8fe2-a945f50b6633',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.044013] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.044829] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.044829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.044829] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8129f9a6-dd83-4203-8fe2-a945f50b6633 with status ACTIVE [ 673.045230] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.045230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.045230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.045426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.045476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.045623] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.045719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.045789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.047282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.047282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.047282] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.047282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.047282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.047282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.047282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.047282] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8129f9a6-dd83-4203-8fe2-a945f50b6633 is going to be updated. [ 673.073087] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.073275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.073370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.073593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.073736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.073940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8129f9a6-dd83-4203-8fe2-a945f50b6633" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.187448] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c60b9686-7de1-476f-8126-57c150974fec in Status: SUCCESS [ 673.188667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.545324] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.687259] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1c00f813-17d2-47f3-b0c3-6df5fb26c746 None None] Enqueued Resource ID: 733a9454-b67c-4a43-add6-322de538074c with Priority: HIGHEST for action port [ 673.688174] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 733a9454-b67c-4a43-add6-322de538074c with Priority: HIGHEST for action port [ 673.688667] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-733a9454-b67c-4a43-add6-322de538074c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.689857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-733a9454-b67c-4a43-add6-322de538074c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.689945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-733a9454-b67c-4a43-add6-322de538074c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.690204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-733a9454-b67c-4a43-add6-322de538074c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.690308] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('733a9454-b67c-4a43-add6-322de538074c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.722474] env[65107]: INFO networking_nsxv3.common.synchronization [None req-2805c0e3-2d8c-4613-8948-2cdbede2a6c5 None None] Enqueued Resource ID: 04207f3f-2f97-4221-a408-b9636cada7e9 with Priority: HIGHEST for action port [ 673.723052] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04207f3f-2f97-4221-a408-b9636cada7e9 with Priority: HIGHEST for action port [ 673.723330] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-04207f3f-2f97-4221-a408-b9636cada7e9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.723482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04207f3f-2f97-4221-a408-b9636cada7e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.723528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04207f3f-2f97-4221-a408-b9636cada7e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.724045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04207f3f-2f97-4221-a408-b9636cada7e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.724045] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04207f3f-2f97-4221-a408-b9636cada7e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.047877] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.048104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.048104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.048346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.048605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.048605] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a469b2f-9178-42b0-be36-f1370374e744 is going to be created. [ 674.078278] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.078483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.078761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.078808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.078989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.090657] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a469b2f-9178-42b0-be36-f1370374e744 in Status: UNINITIALIZED for 2s [ 674.193129] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 733a9454-b67c-4a43-add6-322de538074c [ 674.194046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.194046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.194046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.194046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.194046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.194308] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:733a9454-b67c-4a43-add6-322de538074c already deleted. [ 674.194308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-733a9454-b67c-4a43-add6-322de538074c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.227914] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04207f3f-2f97-4221-a408-b9636cada7e9 [ 674.228191] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.228322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.228385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.228626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.228712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.228843] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04207f3f-2f97-4221-a408-b9636cada7e9 already deleted. [ 674.229157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04207f3f-2f97-4221-a408-b9636cada7e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.936477] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e942673c-5409-41f0-8aed-8bc832e77dc6 None None] Enqueued Resource ID: 6481b4b9-7102-44a0-bbe7-78feb907e261 with Priority: HIGHEST for action port [ 674.937205] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6481b4b9-7102-44a0-bbe7-78feb907e261 with Priority: HIGHEST for action port [ 674.937538] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-6481b4b9-7102-44a0-bbe7-78feb907e261 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.937992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6481b4b9-7102-44a0-bbe7-78feb907e261" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.938309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6481b4b9-7102-44a0-bbe7-78feb907e261" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.938684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6481b4b9-7102-44a0-bbe7-78feb907e261" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.938828] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6481b4b9-7102-44a0-bbe7-78feb907e261',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.155724] env[65107]: INFO networking_nsxv3.common.synchronization [req-86cc116f-c2c5-4e3b-9ba6-91a7730eb0bf req-7eea17d4-8b33-46ab-8b4b-40145bf01e8c tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 675.155724] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 675.156063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.156573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.156652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.156848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.157167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.157167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.157167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.157330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.157419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.157527] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.177412] env[65107]: INFO networking_nsxv3.common.synchronization [req-86cc116f-c2c5-4e3b-9ba6-91a7730eb0bf req-7eea17d4-8b33-46ab-8b4b-40145bf01e8c tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 675.177565] env[65107]: INFO networking_nsxv3.common.synchronization [req-86cc116f-c2c5-4e3b-9ba6-91a7730eb0bf req-7eea17d4-8b33-46ab-8b4b-40145bf01e8c tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 675.177697] env[65107]: INFO networking_nsxv3.common.synchronization [req-86cc116f-c2c5-4e3b-9ba6-91a7730eb0bf req-7eea17d4-8b33-46ab-8b4b-40145bf01e8c tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with Priority: HIGHEST for action port [ 675.178178] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 675.178607] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 675.178741] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with Priority: HIGHEST for action port [ 675.179766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.179766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.179766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.179766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.179766] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.180390] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.182118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.182118] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.182118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.182118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.182118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.182118] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cbfccaf-d3a1-4774-b116-a79ae1cc37eb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.440808] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6481b4b9-7102-44a0-bbe7-78feb907e261 [ 675.441056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.441188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.441256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.441473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.441569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.441675] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6481b4b9-7102-44a0-bbe7-78feb907e261 already deleted. [ 675.441757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6481b4b9-7102-44a0-bbe7-78feb907e261" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.660049] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.684402] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.684542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.684732] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with status ACTIVE [ 675.684901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.685205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.685288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.685508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.685608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.685784] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.685879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.685939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.686110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.686186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.686361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.686450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.686520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.686663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.686736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.686815] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb is going to be updated. [ 675.715958] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.716169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.716264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.716487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.716628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.716795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.887638] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0bfa8950-2459-4eaf-9751-158723f5d3cc tempest-ServersTestFqdnHostnames-2005309367 tempest-ServersTestFqdnHostnames-2005309367-project-member] Enqueued Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_rules [ 675.890153] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_rules [ 675.890153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.890153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.890153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.890153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.890153] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.089306] env[65107]: INFO networking_nsxv3.common.synchronization [None req-84f5b97e-cef5-4bd4-bff4-4963af124057 tempest-ServersTestFqdnHostnames-2005309367 tempest-ServersTestFqdnHostnames-2005309367-project-member] Enqueued Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_rules [ 676.090137] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_rules [ 676.093780] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.093780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.102254] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a469b2f-9178-42b0-be36-f1370374e744 in Status: SUCCESS [ 676.102459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.103092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.103358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.103585] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.103746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.103851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.104020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.104117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.104221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.104319] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.162760] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.414711] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.415054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.415133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.415390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.415533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.415722] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 already deleted. [ 676.415820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.415952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.416239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.416294] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.606512] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.606749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.606883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.607175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.607295] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.607385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.607440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.607586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.607695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.609115] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.609115] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.609115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.609115] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.666255] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.666389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.666432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.666708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.666816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.666934] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be updated. [ 676.700058] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.700260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.700304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.700511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.700655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.711627] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 676.944075] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.944212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.944313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.944532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.944591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.944662] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 already deleted. [ 676.944756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.112260] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a469b2f-9178-42b0-be36-f1370374e744: rpc.has_security_group_logging(os_id): False [ 677.134601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.135164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.135164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.135164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.135508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.135902] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.136620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.136705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.136918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.137041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.137672] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.137672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.137672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.138132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.138132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.138200] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.138857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.138857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.139025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.139236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.139236] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a469b2f-9178-42b0-be36-f1370374e744 is going to be created. [ 677.201152] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.201322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.201380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.201580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.201758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.213463] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a469b2f-9178-42b0-be36-f1370374e744 in Status: IN_PROGRESS for 2s [ 677.776148] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4c347be0-2587-4b14-8d83-682be6d0a558 None None] Enqueued Resource ID: 473af6b5-7673-47c9-a07d-c7958493f67e with Priority: HIGHEST for action port [ 677.776685] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473af6b5-7673-47c9-a07d-c7958493f67e with Priority: HIGHEST for action port [ 677.777076] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-473af6b5-7673-47c9-a07d-c7958493f67e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.777149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-473af6b5-7673-47c9-a07d-c7958493f67e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.777228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-473af6b5-7673-47c9-a07d-c7958493f67e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.777482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-473af6b5-7673-47c9-a07d-c7958493f67e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.777608] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('473af6b5-7673-47c9-a07d-c7958493f67e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.282039] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 473af6b5-7673-47c9-a07d-c7958493f67e [ 678.282039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.282039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.282039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.282583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.282583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.282803] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:473af6b5-7673-47c9-a07d-c7958493f67e already deleted. [ 678.282842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-473af6b5-7673-47c9-a07d-c7958493f67e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.723617] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 678.724171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.724171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.724355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.724540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.724682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.724750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.724897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.724947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.725038] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.229836] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.236553] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a469b2f-9178-42b0-be36-f1370374e744 in Status: SUCCESS [ 679.236704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.733287] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.235689] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.235689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.235888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.236066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.236164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.236268] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be updated. [ 680.263812] env[65107]: INFO networking_nsxv3.common.synchronization [req-682195ed-c12b-4e2f-adad-8216cffdbcc4 req-a0e7bf46-51f7-4427-8823-80099d8396f0 tempest-DeleteServersAdminTestJSON-30165657 tempest-DeleteServersAdminTestJSON-30165657-project-member] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 680.263812] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGHEST for action security_group_members [ 680.264140] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.264140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.264249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.264927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.264927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.264927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.264927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.265220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.265391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.265623] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.296235] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.296883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.296883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.297029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.297308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.311833] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 680.768096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.768437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.768437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.768741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.768741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.769066] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.769066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.769237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.769285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.770112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.770112] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be updated. [ 680.805478] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.805689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.805689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.805991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.806121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.817745] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: IN_PROGRESS for 2s [ 681.652097] env[65107]: INFO networking_nsxv3.common.synchronization [req-42802fee-07dc-4dcf-95f7-b8463cce90fe req-a6aa96f0-2e4a-40be-a731-1f26caf6fbfa tempest-ServersV294TestFqdnHostnames-382574538 tempest-ServersV294TestFqdnHostnames-382574538-project-member] Enqueued Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_members [ 681.654040] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_members [ 681.654040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.654040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.654040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.654040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.654040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.654040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.654040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.654452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.654452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.654526] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.015106] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.015413] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-487" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.015505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-487" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.016510] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-487" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.016980] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.017660] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.017933] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.018640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.018863] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.019158] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.019274] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.019377] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.019479] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.019669] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.019798] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.019933] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.046687] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.047496] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.047496] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.047496] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-487" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.047496] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-dfd2bbd5-bd70-4880-9bab-33082102e2b8 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.047754] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.047754] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.048086] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.048216] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfd2bbd5-bd70-4880-9bab-33082102e2b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.157907] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.157907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.157907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.159425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.159425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.159425] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.159425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.159425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.159425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.159425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.159425] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 already deleted. [ 682.159425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.180193] env[65107]: INFO networking_nsxv3.common.synchronization [None req-8e79f59e-d7a9-4545-a4fc-d3ecda7e5794 None None] Enqueued Resource ID: a76c7dcc-e8d1-4455-8fc3-c271f15457ba with Priority: HIGHEST for action port [ 682.180193] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76c7dcc-e8d1-4455-8fc3-c271f15457ba with Priority: HIGHEST for action port [ 682.181163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a76c7dcc-e8d1-4455-8fc3-c271f15457ba taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.181163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a76c7dcc-e8d1-4455-8fc3-c271f15457ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.181163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a76c7dcc-e8d1-4455-8fc3-c271f15457ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.181903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a76c7dcc-e8d1-4455-8fc3-c271f15457ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.181903] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76c7dcc-e8d1-4455-8fc3-c271f15457ba',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.323572] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 682.323572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.323572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.323814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.323855] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.324599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.324599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.324599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.324599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.324599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325169] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.554630] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.554630] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.554630] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.554630] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.554630] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.554630] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port dfd2bbd5-bd70-4880-9bab-33082102e2b8 not found, creating... [ 682.554630] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.554630] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.558133] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.558709] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.559953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.559953] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.559953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.559953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.560175] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.560235] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.560992] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: dfd2bbd5-bd70-4880-9bab-33082102e2b8 is going to be created. [ 682.582488] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.582787] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.584268] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.584268] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.584268] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.584684] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.684997] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a76c7dcc-e8d1-4455-8fc3-c271f15457ba [ 682.684997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.684997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.686167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.686167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.686167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.686167] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a76c7dcc-e8d1-4455-8fc3-c271f15457ba already deleted. [ 682.686167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a76c7dcc-e8d1-4455-8fc3-c271f15457ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.829529] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.837782] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 001132af-7c6a-44dd-97d6-1576257d23bd in Status: SUCCESS [ 682.838058] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd deletion is rescheduled due to dependency. [ 682.838231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.331468] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de5bb9f6-dc07-4ba1-9bf0-e549fa218d60: rpc.has_security_group_logging(os_id): False [ 683.333230] env[65107]: INFO networking_nsxv3.common.synchronization [req-42802fee-07dc-4dcf-95f7-b8463cce90fe req-e3289da1-5f79-44ee-a7a1-fc3ede6c37d6 service nova] Enqueued Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_rules [ 683.333515] env[65107]: INFO networking_nsxv3.common.synchronization [req-42802fee-07dc-4dcf-95f7-b8463cce90fe req-e3289da1-5f79-44ee-a7a1-fc3ede6c37d6 service nova] Enqueued Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_members [ 683.333714] env[65107]: INFO networking_nsxv3.common.synchronization [req-42802fee-07dc-4dcf-95f7-b8463cce90fe req-e3289da1-5f79-44ee-a7a1-fc3ede6c37d6 service nova] Enqueued Resource ID: dfd2bbd5-bd70-4880-9bab-33082102e2b8 with Priority: HIGHEST for action port [ 683.334395] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_rules [ 683.335031] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_members [ 683.335031] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd2bbd5-bd70-4880-9bab-33082102e2b8 with Priority: HIGHEST for action port [ 683.335707] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.335906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.336962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.336962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.336962] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.338844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.338978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.339046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.339265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.339497] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.339576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.339871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.339871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.339871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.339982] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.344021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfd2bbd5-bd70-4880-9bab-33082102e2b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.344021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.344021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.344021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.344021] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfd2bbd5-bd70-4880-9bab-33082102e2b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.355967] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.355967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.355967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.355967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.355967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.357075] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.357075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.357075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.357075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.357075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.357075] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be updated. [ 683.414388] env[65107]: INFO networking_nsxv3.common.synchronization [req-d35920ab-37a7-47a6-877f-18fd9b3af7ba req-9c1c998d-d36e-4fad-bb5b-a689958ce5b4 tempest-ImagesOneServerTestJSON-996413779 tempest-ImagesOneServerTestJSON-996413779-project-member] Enqueued Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_members [ 683.414928] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGHEST for action security_group_members [ 683.415290] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.415410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.415477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.415701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.415851] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.415955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.416252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.416475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.416643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.416806] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.432478] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.432629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.432693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.432917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.433127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.464517] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 683.839502] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.839502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.844670] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.849141] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfd2bbd5-bd70-4880-9bab-33082102e2b8 with status ACTIVE [ 683.849141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.849141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.849141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.849745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.849745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.849745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.849745] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfd2bbd5-bd70-4880-9bab-33082102e2b8 is going to be updated. [ 683.871237] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.871903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.871903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.871903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.871903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.872187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfd2bbd5-bd70-4880-9bab-33082102e2b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.913515] env[65107]: INFO networking_nsxv3.common.synchronization [None req-178a6c87-2db2-471d-9186-d4479d781d2d tempest-ServersTestJSON-844015729 tempest-ServersTestJSON-844015729-project-member] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_rules [ 683.914286] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_rules [ 683.914625] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.914860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.914962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.915201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.915296] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.918569] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.918569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.918764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.918914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.919013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.919235] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.919301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.919379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.919507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.919587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.919864] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 is going to be updated. [ 683.973320] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.973474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.973545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.974158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.974398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.997558] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 in Status: IN_PROGRESS for 2s [ 684.023099] env[65107]: INFO networking_nsxv3.common.synchronization [req-55390fca-841f-42ea-948a-ebefd327b046 req-9ff1b98f-ca11-42c6-bacd-21d4956a4b99 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 684.023099] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 684.023277] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.023277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.023395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.024948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.024948] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.024948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.024948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.024948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.024948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.024948] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.040058] env[65107]: INFO networking_nsxv3.common.synchronization [req-55390fca-841f-42ea-948a-ebefd327b046 req-9ff1b98f-ca11-42c6-bacd-21d4956a4b99 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 684.040269] env[65107]: INFO networking_nsxv3.common.synchronization [req-55390fca-841f-42ea-948a-ebefd327b046 req-9ff1b98f-ca11-42c6-bacd-21d4956a4b99 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 684.040411] env[65107]: INFO networking_nsxv3.common.synchronization [req-55390fca-841f-42ea-948a-ebefd327b046 req-9ff1b98f-ca11-42c6-bacd-21d4956a4b99 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with Priority: HIGHEST for action port [ 684.041220] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_rules [ 684.041367] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 684.041558] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with Priority: HIGHEST for action port [ 684.041852] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.041987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.042233] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.042379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.042490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.042590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.042659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.042846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.042942] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cbfccaf-d3a1-4774-b116-a79ae1cc37eb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.131614] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3dd8c10b-32ef-4c8e-a47d-c18778a0a6a9 tempest-ServersTestJSON-844015729 tempest-ServersTestJSON-844015729-project-member] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_rules [ 684.132074] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_rules [ 684.132388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.132594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.347327] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.437042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.437042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.437276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.437525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.437525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.437525] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b already deleted. [ 684.437717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.438415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.438415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.438415] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.528790] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.534027] env[65107]: INFO networking_nsxv3.common.synchronization [req-fd0daee8-1164-4d1e-ac76-58020b16c4ff req-81b1b7c0-3434-4ea6-8ac8-7b06ce1b2268 tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 684.534515] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 684.535027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.535279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.535404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.535764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.535764] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.535875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.535875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.536042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.536756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.536756] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.545188] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb with status ACTIVE [ 684.545503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.545703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.545824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.546064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.546179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.546400] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.546602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.546674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.546813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.547272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.547272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.547272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.547272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.547457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.547491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.547566] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cbfccaf-d3a1-4774-b116-a79ae1cc37eb is going to be updated. [ 684.571048] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.571302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.571302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.571579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.571780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.571967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cbfccaf-d3a1-4774-b116-a79ae1cc37eb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.814488] env[65107]: INFO networking_nsxv3.common.synchronization [None req-d5a807f5-61ed-4409-ae62-c93f95a8403e None None] Enqueued Resource ID: 905d82a5-617c-46e6-8cad-abc1065a5d11 with Priority: HIGHEST for action port [ 684.814488] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905d82a5-617c-46e6-8cad-abc1065a5d11 with Priority: HIGHEST for action port [ 684.814488] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-905d82a5-617c-46e6-8cad-abc1065a5d11 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.814488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-905d82a5-617c-46e6-8cad-abc1065a5d11" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.814488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-905d82a5-617c-46e6-8cad-abc1065a5d11" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.814488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-905d82a5-617c-46e6-8cad-abc1065a5d11" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.814488] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('905d82a5-617c-46e6-8cad-abc1065a5d11',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.852167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.852167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.852167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.852167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.852979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.852979] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 is going to be created. [ 684.878782] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.879071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.879071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.879286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.879374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.891994] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 in Status: UNINITIALIZED for 2s [ 684.968018] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.968289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.968403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.968705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.969182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.969362] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b already deleted. [ 684.975454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.032959] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.040579] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.040579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.040579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.040737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.040769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.041523] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.041523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.041523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.041523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.041690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.041690] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 685.070995] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.072190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.072190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.072190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.072190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.083701] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 685.318112] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 905d82a5-617c-46e6-8cad-abc1065a5d11 [ 685.318226] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.318696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.318696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.318850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.318850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.319234] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:905d82a5-617c-46e6-8cad-abc1065a5d11 already deleted. [ 685.319234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-905d82a5-617c-46e6-8cad-abc1065a5d11" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.487932] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 685.488284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.488410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.488698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.488802] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.536129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.536302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.536302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.536771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.536771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.536886] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be updated. [ 685.573209] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.573353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.573424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.573754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.573987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.584242] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 685.666668] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.666971] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.667044] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.667484] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.667844] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.668028] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.668229] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.668795] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.668795] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.668971] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.669176] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.669354] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.669507] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.669698] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.669849] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.670026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.690790] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.690984] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.691350] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.691724] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.691900] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.692094] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.692231] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.692511] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.692640] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e9e5e6d-c18c-4bc4-b299-63439f2e2521',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.990914] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.991086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.010428] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 in Status: SUCCESS [ 686.010609] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 deletion is rescheduled due to dependency. [ 686.010733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.195605] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.196020] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.196308] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.198700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.198700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.198700] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 0e9e5e6d-c18c-4bc4-b299-63439f2e2521 not found, creating... [ 686.198700] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.198700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.198700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.198700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.198700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.198700] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.200290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.200290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.200527] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.201114] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.201739] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 0e9e5e6d-c18c-4bc4-b299-63439f2e2521 is going to be created. [ 686.223148] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.223299] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.223374] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.224668] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.224668] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.224668] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.544743] env[65107]: INFO networking_nsxv3.common.synchronization [req-eff573d5-f174-4d63-a2ee-d668d6aa7906 req-e542e9b8-86b4-4de4-9b64-96116ac0075a tempest-VolumesAdminNegativeTest-419586370 tempest-VolumesAdminNegativeTest-419586370-project-member] Enqueued Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_members [ 686.545684] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGHEST for action security_group_members [ 686.545684] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.545815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.545877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.546119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.546298] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.546420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.546485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.546649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.546747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.546844] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.903950] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 in Status: SUCCESS [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.903950] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.903950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.904386] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.948594] env[65107]: INFO networking_nsxv3.common.synchronization [req-fd0daee8-1164-4d1e-ac76-58020b16c4ff req-06a6dc34-593f-42ba-9381-dc8123be8746 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 686.948818] env[65107]: INFO networking_nsxv3.common.synchronization [req-fd0daee8-1164-4d1e-ac76-58020b16c4ff req-06a6dc34-593f-42ba-9381-dc8123be8746 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 686.948955] env[65107]: INFO networking_nsxv3.common.synchronization [req-fd0daee8-1164-4d1e-ac76-58020b16c4ff req-06a6dc34-593f-42ba-9381-dc8123be8746 service nova] Enqueued Resource ID: 0e9e5e6d-c18c-4bc4-b299-63439f2e2521 with Priority: HIGHEST for action port [ 686.949845] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 686.949845] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 686.949947] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e9e5e6d-c18c-4bc4-b299-63439f2e2521 with Priority: HIGHEST for action port [ 686.950246] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.950397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.950430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.950609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.950684] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.951783] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.951885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.952091] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.952202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.952265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.952499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.952585] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e9e5e6d-c18c-4bc4-b299-63439f2e2521',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.052681] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.052681] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.052681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.052681] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60b9686-7de1-476f-8126-57c150974fec is going to be updated. [ 687.081788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.081925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.082541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.082541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.082541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.101036] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60b9686-7de1-476f-8126-57c150974fec in Status: IN_PROGRESS for 2s [ 687.101036] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 687.101036] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 deletion is rescheduled due to dependency. [ 687.101036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.101248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.101562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.101630] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.101691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.101759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.101911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.101991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.102097] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.405981] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.453838] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.454041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.454273] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e9e5e6d-c18c-4bc4-b299-63439f2e2521 with status ACTIVE [ 687.454476] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.454625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.454716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.454931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.455072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.455953] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.455953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.455953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.455953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.455953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.456490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.456490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.456490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.456490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.456490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.456724] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e9e5e6d-c18c-4bc4-b299-63439f2e2521 is going to be updated. [ 687.481521] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.481737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.481737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.481878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.482035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.482192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e9e5e6d-c18c-4bc4-b299-63439f2e2521" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.599617] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 687.599937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.600101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.600340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.600564] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.600710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.600813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.600946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.601035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.601140] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.605691] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.908740] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 602f9ef3-38ee-4e8b-912d-c998fbcbbe73: rpc.has_security_group_logging(os_id): False [ 687.931304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.931596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.931728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.932018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.932179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.932509] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.932729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.932839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.933128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.933270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.933397] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 is going to be created. [ 688.002494] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.002728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.002851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.003204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.003438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.016579] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 in Status: IN_PROGRESS for 2s [ 688.107953] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.109027] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.621023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.621023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.621023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.621023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.621023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.621023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 688.621023] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.666026] env[65107]: INFO networking_nsxv3.common.synchronization [None req-caf4abc0-1326-41cf-a09b-58459ac5ee3a None None] Enqueued Resource ID: 6941f9a7-e720-49c7-81f9-efbd9af85183 with Priority: HIGHEST for action port [ 688.666026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.666026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.666026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.666026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.666026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.668140] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6941f9a7-e720-49c7-81f9-efbd9af85183 with Priority: HIGHEST for action port [ 688.669742] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-6941f9a7-e720-49c7-81f9-efbd9af85183 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.670085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6941f9a7-e720-49c7-81f9-efbd9af85183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.670273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6941f9a7-e720-49c7-81f9-efbd9af85183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.671063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6941f9a7-e720-49c7-81f9-efbd9af85183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.671063] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6941f9a7-e720-49c7-81f9-efbd9af85183',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.683451] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 688.819280] env[65107]: INFO networking_nsxv3.common.synchronization [None req-45f390e4-1905-4a86-8640-cefb263cfdad None None] Enqueued Resource ID: 7b605a5d-635d-4454-bc51-6528840624ca with Priority: HIGHEST for action port [ 688.821450] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b605a5d-635d-4454-bc51-6528840624ca with Priority: HIGHEST for action port [ 688.822234] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b605a5d-635d-4454-bc51-6528840624ca taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.822860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b605a5d-635d-4454-bc51-6528840624ca" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.822949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b605a5d-635d-4454-bc51-6528840624ca" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.823251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b605a5d-635d-4454-bc51-6528840624ca" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.823342] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b605a5d-635d-4454-bc51-6528840624ca',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.113164] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60b9686-7de1-476f-8126-57c150974fec in Status: SUCCESS [ 689.113514] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60b9686-7de1-476f-8126-57c150974fec deletion is rescheduled due to dependency. [ 689.113751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.124270] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.124455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.124487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.125471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.125471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.125647] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be updated. [ 689.161698] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.161698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.161698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.161698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.161911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.174537] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6941f9a7-e720-49c7-81f9-efbd9af85183 [ 689.175124] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.175124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.175124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.175505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.175505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.175645] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6941f9a7-e720-49c7-81f9-efbd9af85183 already deleted. [ 689.175755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6941f9a7-e720-49c7-81f9-efbd9af85183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.176808] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 689.325519] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b605a5d-635d-4454-bc51-6528840624ca [ 689.325752] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.325899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.325944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.326339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.326339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.326419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b605a5d-635d-4454-bc51-6528840624ca already deleted. [ 689.326460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b605a5d-635d-4454-bc51-6528840624ca" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.031044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 in Status: SUCCESS [ 690.031370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.695598] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 690.696258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.697032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.697032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.697130] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.698127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.698127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.698127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.698127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.698127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.698127] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.190031] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 691.190443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.190443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.190751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.190840] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.190943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.191014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.191169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.191260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.191344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.191436] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.206894] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.206894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.207087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.207259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.207424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.207524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.207588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.207730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.207902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.208009] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.208293] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.208397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.208464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.208612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.208780] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.208923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.208923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.209062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.209128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.209209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.209295] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.695163] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.713162] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57ccc978-a1f0-4c03-8296-5acfbdaf68e4: rpc.has_security_group_logging(os_id): False [ 691.735083] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.735083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.735083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.735083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.735264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.735301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.735413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.735504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.735653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.735736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.737267] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.737267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.737267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.737267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.737267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.737267] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.737267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.737267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.737590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.737590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.737590] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 691.814941] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.815180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.815244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.815530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.815686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.835942] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 692.200765] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de5bb9f6-dc07-4ba1-9bf0-e549fa218d60: rpc.has_security_group_logging(os_id): False [ 692.221297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.221297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.221297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.221427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.221427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.223026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.223026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.223026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.223026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.223026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.223026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be updated. [ 692.253292] env[65107]: INFO networking_nsxv3.common.synchronization [None req-c75bb1d8-9ec1-40ce-9db1-36093e3c2e5d None None] Enqueued Resource ID: b4852718-295b-48af-afba-17c4a1ee9cb9 with Priority: HIGHEST for action port [ 692.253292] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4852718-295b-48af-afba-17c4a1ee9cb9 with Priority: HIGHEST for action port [ 692.253292] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4852718-295b-48af-afba-17c4a1ee9cb9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.253292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4852718-295b-48af-afba-17c4a1ee9cb9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.253292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4852718-295b-48af-afba-17c4a1ee9cb9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.253292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4852718-295b-48af-afba-17c4a1ee9cb9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.253292] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4852718-295b-48af-afba-17c4a1ee9cb9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.294930] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.295357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.295519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.295892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.297451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.313906] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 692.610992] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0c698303-2e5c-4956-b84b-960695028cbe None None] Enqueued Resource ID: 1a64c099-00f4-41eb-a0f9-6f30edab9939 with Priority: HIGHEST for action port [ 692.612192] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a64c099-00f4-41eb-a0f9-6f30edab9939 with Priority: HIGHEST for action port [ 692.612537] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a64c099-00f4-41eb-a0f9-6f30edab9939 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.613094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a64c099-00f4-41eb-a0f9-6f30edab9939" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.613094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a64c099-00f4-41eb-a0f9-6f30edab9939" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.613094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a64c099-00f4-41eb-a0f9-6f30edab9939" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.613267] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a64c099-00f4-41eb-a0f9-6f30edab9939',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.755574] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4852718-295b-48af-afba-17c4a1ee9cb9 [ 692.757062] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.757062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.757062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.757062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.757062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.757062] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4852718-295b-48af-afba-17c4a1ee9cb9 already deleted. [ 692.757062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4852718-295b-48af-afba-17c4a1ee9cb9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.797915] env[65107]: INFO networking_nsxv3.common.synchronization [None req-a3cfd0bc-00f8-4766-aa25-8226c37431bc None None] Enqueued Resource ID: 5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5 with Priority: HIGHEST for action port [ 692.799031] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5 with Priority: HIGHEST for action port [ 692.799682] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.799838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.799913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.800223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.800310] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.116198] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a64c099-00f4-41eb-a0f9-6f30edab9939 [ 693.116435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.116562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.116704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.116879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.117109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.117109] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a64c099-00f4-41eb-a0f9-6f30edab9939 already deleted. [ 693.117233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a64c099-00f4-41eb-a0f9-6f30edab9939" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.305726] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5 [ 693.306216] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.306216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.306216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.306930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.306930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.306930] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5 already deleted. [ 693.306930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f4c50dd-9ed3-4db6-b1ad-5542b9ea7bd5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.517140] env[65107]: INFO networking_nsxv3.common.synchronization [req-788668fb-a967-4026-b3d0-684950a2e0d6 req-94a42264-e8ef-445c-b3f1-45828e7b9f71 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 693.517711] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 693.518788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.519809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.519894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.524686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.524686] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.524686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.524897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.525010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.525156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.525212] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.745247] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3ad4480a-0df1-4dbf-a1fc-47ef135131bb tempest-ServerActionsV293TestJSON-867971376 tempest-ServerActionsV293TestJSON-867971376-project-member] Enqueued Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_rules [ 693.748159] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_rules [ 693.748159] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9be39cfe-e706-4bf7-8816-70542b5cb472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.748159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.748159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.748159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.748159] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.849652] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 693.852234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.031783] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.031931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.032094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.032222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.032321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.032527] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.032638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.032685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.032909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.032909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.032975] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 already deleted. [ 694.033146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.141168] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.141698] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-643" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.141698] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-643" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.142040] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-643" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.145583] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.146865] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.146865] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.146865] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.146865] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.146865] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.146865] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.146865] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.146865] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.147411] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.147411] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.147411] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.171954] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.171954] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.171954] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.171954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-643" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.172267] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.172439] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.172661] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.173045] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.173772] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.271637] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.271788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.271939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.272226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.273095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.273095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 already deleted. [ 694.273095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.334381] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 694.334753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.450378] env[65107]: INFO networking_nsxv3.common.synchronization [None req-55448969-37e6-4c73-8f07-f11a94aafa61 tempest-ServerActionsV293TestJSON-867971376 tempest-ServerActionsV293TestJSON-867971376-project-member] Enqueued Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_rules [ 694.451641] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_rules [ 694.451641] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9be39cfe-e706-4bf7-8816-70542b5cb472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.451641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.451641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.451641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.451641] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.676531] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.677475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.677475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.677475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.677623] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.677755] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 not found, creating... [ 694.678051] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.678210] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.678320] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.678610] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.678671] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.679053] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.679326] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.679483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.679615] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.680252] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.680252] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 is going to be created. [ 694.701090] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.701353] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.701516] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.701819] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.702059] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.702281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.982896] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.984857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.984857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.984857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.984857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.984857] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 already deleted. [ 694.984857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.411962] env[65107]: INFO networking_nsxv3.common.synchronization [None req-08a65e79-7037-4d93-b567-f31613226bd9 None None] Enqueued Resource ID: 508a6fbc-e121-44a2-9365-ba2ca3f5be41 with Priority: HIGHEST for action port [ 695.411962] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 508a6fbc-e121-44a2-9365-ba2ca3f5be41 with Priority: HIGHEST for action port [ 695.412530] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-508a6fbc-e121-44a2-9365-ba2ca3f5be41 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.412696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-508a6fbc-e121-44a2-9365-ba2ca3f5be41" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.412799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-508a6fbc-e121-44a2-9365-ba2ca3f5be41" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.413865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-508a6fbc-e121-44a2-9365-ba2ca3f5be41" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.413865] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('508a6fbc-e121-44a2-9365-ba2ca3f5be41',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.451124] env[65107]: INFO networking_nsxv3.common.synchronization [req-788668fb-a967-4026-b3d0-684950a2e0d6 req-431b927b-f723-470b-a767-78c77899e720 service nova] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_rules [ 695.451124] env[65107]: INFO networking_nsxv3.common.synchronization [req-788668fb-a967-4026-b3d0-684950a2e0d6 req-431b927b-f723-470b-a767-78c77899e720 service nova] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 695.451124] env[65107]: INFO networking_nsxv3.common.synchronization [req-788668fb-a967-4026-b3d0-684950a2e0d6 req-431b927b-f723-470b-a767-78c77899e720 service nova] Enqueued Resource ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with Priority: HIGHEST for action port [ 695.451124] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_rules [ 695.451124] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 695.451124] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with Priority: HIGHEST for action port [ 695.451404] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.451535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.451577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.451989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.452522] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.454210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.454346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.454412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.454615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.454816] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.454876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.455287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.455287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.455287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.455398] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.456802] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.457044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.457182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.457468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.457591] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.915916] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 508a6fbc-e121-44a2-9365-ba2ca3f5be41 [ 695.916900] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.916900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.916900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.916900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.916900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.916900] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:508a6fbc-e121-44a2-9365-ba2ca3f5be41 already deleted. [ 695.916900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-508a6fbc-e121-44a2-9365-ba2ca3f5be41" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.962663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.962663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.962663] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.962663] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with status ACTIVE [ 695.962663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.965641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.965844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.967201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.967201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.967201] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.967201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.967201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.967201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.967201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.971036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.971036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.971036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.971352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.971352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.971403] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 is going to be updated. [ 695.995821] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.996185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.996185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.996467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.996587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.996778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.473566] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.834231] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1ed99bbf-aded-48a2-8c25-575df6dbf971 None None] Enqueued Resource ID: a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667 with Priority: HIGHEST for action port [ 696.834759] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667 with Priority: HIGHEST for action port [ 696.835114] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.835307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.835384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.835651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.835768] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.933471] env[65107]: INFO networking_nsxv3.common.synchronization [None req-120b2a7e-56bc-4819-bffd-e88815ce4dfb None None] Enqueued Resource ID: a34cbe51-674e-44e5-b632-68062e7b2ba9 with Priority: HIGHEST for action port [ 696.934015] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cbe51-674e-44e5-b632-68062e7b2ba9 with Priority: HIGHEST for action port [ 696.934336] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a34cbe51-674e-44e5-b632-68062e7b2ba9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.934466] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a34cbe51-674e-44e5-b632-68062e7b2ba9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.934555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a34cbe51-674e-44e5-b632-68062e7b2ba9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.934774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a34cbe51-674e-44e5-b632-68062e7b2ba9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.934850] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a34cbe51-674e-44e5-b632-68062e7b2ba9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.977327] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.977504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.977504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.977756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.978581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.978712] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be created. [ 697.004735] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.005041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.005188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.005728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.006380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.017973] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: UNINITIALIZED for 2s [ 697.234494] env[65107]: INFO networking_nsxv3.common.synchronization [req-ceb2dd8c-0cd8-4ecf-944d-27fe91f4b906 req-83847bcb-8685-466b-89e7-68ebda5ba7e0 tempest-AttachInterfacesUnderV243Test-1437804318 tempest-AttachInterfacesUnderV243Test-1437804318-project-member] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 697.235149] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGHEST for action security_group_members [ 697.235473] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.235599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.235668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.235865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.239077] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.239428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.239428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.239580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.239681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.241496] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.338876] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667 [ 697.339163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.339292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.339357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.339971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.339971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.339971] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667 already deleted. [ 697.339971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2fc39ee-ab8c-44c5-aa9a-e5b0b1212667" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.443999] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a34cbe51-674e-44e5-b632-68062e7b2ba9 [ 697.443999] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.443999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.443999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.443999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.443999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.444278] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a34cbe51-674e-44e5-b632-68062e7b2ba9 already deleted. [ 697.444278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a34cbe51-674e-44e5-b632-68062e7b2ba9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.746815] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.746815] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.746815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.746815] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be updated. [ 697.774937] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.776661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.776661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.776661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.776661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.788165] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: IN_PROGRESS for 2s [ 697.793797] env[65107]: INFO networking_nsxv3.common.synchronization [req-f2022094-1a07-4ce5-955b-219aeb9b37ac req-6751e5fc-ccf1-4133-b3fd-c5eca05a0366 tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 697.794980] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 697.794980] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.794980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.795169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.795277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.795425] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.795520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.795596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.795958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.797057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.797057] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.214184] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-100 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.214287] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.214401] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.214643] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.214906] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.218304] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.218304] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.218304] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.218304] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.218304] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.218304] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.218304] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.218304] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.218304] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.218304] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.218304] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.240366] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.240366] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.240603] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.240603] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.240868] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-fed152ab-fe26-498a-8e05-9c126c2a6abb taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.242019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.242019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.242231] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.242958] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fed152ab-fe26-498a-8e05-9c126c2a6abb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.299292] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.745870] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.746101] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.746222] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.746505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.746670] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.746840] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port fed152ab-fe26-498a-8e05-9c126c2a6abb not found, creating... [ 698.747164] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.747256] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.747368] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.747579] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.747710] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.747983] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.748143] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.748253] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.748447] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.748649] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.748693] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: fed152ab-fe26-498a-8e05-9c126c2a6abb is going to be created. [ 698.769672] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.769927] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.770253] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.770603] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.770913] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.771201] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.803578] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.029498] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 699.029723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.029901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.030134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.030328] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.030442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.030509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.030655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.030734] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.030815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.030926] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.223945] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0286c4e1-4692-4203-87bb-b7c4124f9422 None None] Enqueued Resource ID: 15962c2d-3f0d-47ac-9a2b-a0f44521d750 with Priority: HIGHEST for action port [ 699.224372] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15962c2d-3f0d-47ac-9a2b-a0f44521d750 with Priority: HIGHEST for action port [ 699.227569] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-15962c2d-3f0d-47ac-9a2b-a0f44521d750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.227764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15962c2d-3f0d-47ac-9a2b-a0f44521d750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.228601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15962c2d-3f0d-47ac-9a2b-a0f44521d750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.228892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15962c2d-3f0d-47ac-9a2b-a0f44521d750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.228988] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15962c2d-3f0d-47ac-9a2b-a0f44521d750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.306998] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.306998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.306998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.306998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.306998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.306998] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 699.343447] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.343447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.343447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.343447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.343447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.354651] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 699.531728] env[65107]: INFO networking_nsxv3.common.synchronization [req-f2022094-1a07-4ce5-955b-219aeb9b37ac req-37363099-38a5-46ae-99d1-ae7a9aae0c7f service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 699.531948] env[65107]: INFO networking_nsxv3.common.synchronization [req-f2022094-1a07-4ce5-955b-219aeb9b37ac req-37363099-38a5-46ae-99d1-ae7a9aae0c7f service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 699.532064] env[65107]: INFO networking_nsxv3.common.synchronization [req-f2022094-1a07-4ce5-955b-219aeb9b37ac req-37363099-38a5-46ae-99d1-ae7a9aae0c7f service nova] Enqueued Resource ID: fed152ab-fe26-498a-8e05-9c126c2a6abb with Priority: HIGHEST for action port [ 699.532555] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 699.532697] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 699.532806] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed152ab-fe26-498a-8e05-9c126c2a6abb with Priority: HIGHEST for action port [ 699.533369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.533518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.533658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.533903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.534121] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.534251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.534338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.534522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.534656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.534768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.535084] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.535084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.535084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.535290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.535452] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.535575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.535658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.535819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.535925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.536038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.536159] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.537166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.537399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.537399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.537591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.537696] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.542131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.542222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.542418] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-fed152ab-fe26-498a-8e05-9c126c2a6abb taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.542532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.542595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.542764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.542851] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fed152ab-fe26-498a-8e05-9c126c2a6abb',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.731065] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15962c2d-3f0d-47ac-9a2b-a0f44521d750 [ 699.731517] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.732673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.732673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.732673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.732673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.732673] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15962c2d-3f0d-47ac-9a2b-a0f44521d750 already deleted. [ 699.732673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15962c2d-3f0d-47ac-9a2b-a0f44521d750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.800688] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 in Status: SUCCESS [ 699.801239] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 deletion is rescheduled due to dependency. [ 699.801239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.047059] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fed152ab-fe26-498a-8e05-9c126c2a6abb with status ACTIVE [ 700.047059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.047059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.047059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.048731] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.048985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.048985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.049146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.051020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.051020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fed152ab-fe26-498a-8e05-9c126c2a6abb is going to be updated. [ 700.051020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2304da05-6fdb-4605-ba99-e497cf0fe331: rpc.has_security_group_logging(os_id): False [ 700.051542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.051686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.071176] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.071321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.071393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.071768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.071825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.072500] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.072500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.072500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.072500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.072500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.072766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.072987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.072987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.072987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.073160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.073286] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.073382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.074062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.074062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.074062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.074062] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be created. [ 700.079805] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.080045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.080116] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.080334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.080479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.080648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fed152ab-fe26-498a-8e05-9c126c2a6abb" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.271388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.271571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.271571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.272366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.272366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.312527] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 701.085529] env[65107]: INFO networking_nsxv3.common.synchronization [None req-571e3b18-a346-4525-8dac-976836a08791 None None] Enqueued Resource ID: 2bc5654f-a04b-4be2-b4fd-7710e2dd12b7 with Priority: HIGHEST for action port [ 701.086055] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc5654f-a04b-4be2-b4fd-7710e2dd12b7 with Priority: HIGHEST for action port [ 701.086364] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bc5654f-a04b-4be2-b4fd-7710e2dd12b7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.086482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bc5654f-a04b-4be2-b4fd-7710e2dd12b7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.086547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bc5654f-a04b-4be2-b4fd-7710e2dd12b7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.086805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bc5654f-a04b-4be2-b4fd-7710e2dd12b7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.086914] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc5654f-a04b-4be2-b4fd-7710e2dd12b7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.234669] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f611eb59-aeb5-400e-95a2-c8e5b2a426e7 tempest-MigrationsAdminTest-1967309458 tempest-MigrationsAdminTest-1967309458-project-member] Enqueued Resource ID: 294514c6-d6be-413e-a60f-91ce5b07553d with Priority: HIGHEST for action security_group_rules [ 701.234669] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294514c6-d6be-413e-a60f-91ce5b07553d with Priority: HIGHEST for action security_group_rules [ 701.235108] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-294514c6-d6be-413e-a60f-91ce5b07553d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.235305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.235435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.235641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.235801] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('294514c6-d6be-413e-a60f-91ce5b07553d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.368136] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 701.368876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.369768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.369993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.370224] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.371081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.371081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.371081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.371081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.371081] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.444715] env[65107]: INFO networking_nsxv3.common.synchronization [None req-9727bd1d-78ac-421f-9e02-eee6819dbbbd tempest-VolumesAssistedSnapshotsTest-73147858 tempest-VolumesAssistedSnapshotsTest-73147858-project-member] Enqueued Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_rules [ 701.445660] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_rules [ 701.445864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-560f9d77-f914-4f8b-bc22-1688e970b817 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.445864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.445934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.446223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.446313] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.579992] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f8c0f9e3-616f-4e64-a1d6-4bc7326c5edd tempest-MigrationsAdminTest-1967309458 tempest-MigrationsAdminTest-1967309458-project-member] Enqueued Resource ID: 294514c6-d6be-413e-a60f-91ce5b07553d with Priority: HIGHEST for action security_group_rules [ 701.580740] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294514c6-d6be-413e-a60f-91ce5b07553d with Priority: HIGHEST for action security_group_rules [ 701.581138] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-294514c6-d6be-413e-a60f-91ce5b07553d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.581278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.594029] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bc5654f-a04b-4be2-b4fd-7710e2dd12b7 [ 701.594262] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.594593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.594593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.594921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.594921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.595184] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bc5654f-a04b-4be2-b4fd-7710e2dd12b7 already deleted. [ 701.595222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bc5654f-a04b-4be2-b4fd-7710e2dd12b7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.645977] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0f2e370d-5fa6-4fd7-b81e-4014477554cd tempest-VolumesAssistedSnapshotsTest-73147858 tempest-VolumesAssistedSnapshotsTest-73147858-project-member] Enqueued Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_rules [ 701.646567] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_rules [ 701.646843] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-560f9d77-f914-4f8b-bc22-1688e970b817 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.647023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.764932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.764932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.764932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.764932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.764932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.764932] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 294514c6-d6be-413e-a60f-91ce5b07553d already deleted. [ 701.764932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.764932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.764932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.764932] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('294514c6-d6be-413e-a60f-91ce5b07553d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.872859] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.973175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.973330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.973400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.973614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.973741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.973890] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 560f9d77-f914-4f8b-bc22-1688e970b817 already deleted. [ 701.973942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.974172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.974567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.974567] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.295022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.295022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.295022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.295022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.295022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.295022] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 294514c6-d6be-413e-a60f-91ce5b07553d already deleted. [ 702.295500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-294514c6-d6be-413e-a60f-91ce5b07553d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.328132] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 702.331118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.375578] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.501657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.501838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.501882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.502150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.502250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.502358] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 560f9d77-f914-4f8b-bc22-1688e970b817 already deleted. [ 702.502569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.878135] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.878297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.878363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.878597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.878673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.878762] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 702.911177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.911177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.911177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.911523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.911523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.922815] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 703.521779] env[65107]: INFO networking_nsxv3.common.synchronization [req-10ff1633-1b85-43e2-82b2-13c7415685e6 req-16033da5-00f6-4467-bb98-0cf6e22627ed tempest-InstanceActionsTestJSON-620540974 tempest-InstanceActionsTestJSON-620540974-project-member] Enqueued Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_members [ 703.523984] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_members [ 703.523984] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.523984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.523984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.523984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.523984] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.523984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.524355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.524355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.524915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.524915] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.027475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.027710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.027710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.027961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.028077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.028241] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.028349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.028412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.028536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.028621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.028721] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 already deleted. [ 704.028844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.084294] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-82 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.085143] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-82" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.085143] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-82" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.085685] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-82" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.087023] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.087023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.087023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.087345] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.087345] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.087655] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.087846] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.088041] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.088591] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.088591] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.088591] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.088788] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.112271] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.112703] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.112703] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.112838] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-82" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.113092] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-562720b9-5307-4b2a-85ae-9454490a5827 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.113293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.113434] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.113794] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.114478] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('562720b9-5307-4b2a-85ae-9454490a5827',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.505848] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7982081a-b825-46a7-9353-940ca83a74a2 None None] Enqueued Resource ID: 15c5642b-a666-4b93-8544-1da1af025d9d with Priority: HIGHEST for action port [ 704.507041] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c5642b-a666-4b93-8544-1da1af025d9d with Priority: HIGHEST for action port [ 704.507400] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-15c5642b-a666-4b93-8544-1da1af025d9d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.507543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15c5642b-a666-4b93-8544-1da1af025d9d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.507612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15c5642b-a666-4b93-8544-1da1af025d9d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.507951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15c5642b-a666-4b93-8544-1da1af025d9d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.508028] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15c5642b-a666-4b93-8544-1da1af025d9d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.616585] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.616912] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.616962] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.617269] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.617631] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.617631] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 562720b9-5307-4b2a-85ae-9454490a5827 not found, creating... [ 704.617825] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.617988] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.618271] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.618427] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.618560] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.618845] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.619025] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.619143] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.619345] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.619467] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.619594] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 562720b9-5307-4b2a-85ae-9454490a5827 is going to be created. [ 704.643529] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.643761] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.643844] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.644134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.644392] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.644613] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.939946] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 704.939946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.939946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.940309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.940426] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.940501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.940501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.940641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.940716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.940801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.940895] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.015097] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15c5642b-a666-4b93-8544-1da1af025d9d [ 705.015097] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.015097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.015097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.015097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.015097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.015097] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15c5642b-a666-4b93-8544-1da1af025d9d already deleted. [ 705.015097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15c5642b-a666-4b93-8544-1da1af025d9d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.448172] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.449022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.449022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.449340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.449626] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.449930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.449930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.450179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.450325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.450476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.450650] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.450750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.450810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.450957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.451148] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.451546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.451546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.451546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.451546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.451736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.451736] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.473933] env[65107]: INFO networking_nsxv3.common.synchronization [req-10ff1633-1b85-43e2-82b2-13c7415685e6 req-f276389b-fba4-43aa-8f49-8ff30eaac921 service nova] Enqueued Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_rules [ 705.474185] env[65107]: INFO networking_nsxv3.common.synchronization [req-10ff1633-1b85-43e2-82b2-13c7415685e6 req-f276389b-fba4-43aa-8f49-8ff30eaac921 service nova] Enqueued Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_members [ 705.474326] env[65107]: INFO networking_nsxv3.common.synchronization [req-10ff1633-1b85-43e2-82b2-13c7415685e6 req-f276389b-fba4-43aa-8f49-8ff30eaac921 service nova] Enqueued Resource ID: 562720b9-5307-4b2a-85ae-9454490a5827 with Priority: HIGHEST for action port [ 705.474815] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_rules [ 705.474954] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_members [ 705.475064] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562720b9-5307-4b2a-85ae-9454490a5827 with Priority: HIGHEST for action port [ 705.475356] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.475521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.475621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.475908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.476979] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.476979] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.477171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.477171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.477343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.477503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.477598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.477659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.477798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.477883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.477979] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.479454] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-562720b9-5307-4b2a-85ae-9454490a5827 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.479454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.479454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.479572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.479599] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('562720b9-5307-4b2a-85ae-9454490a5827',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.954660] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d43e6dbc-45c8-476b-af04-082906b1ad4d: rpc.has_security_group_logging(os_id): False [ 705.974472] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.974716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.974716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.974918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.975019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.975230] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.975329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.975395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.975543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.975623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.975795] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.975888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.975950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.976113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.976189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.977367] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.977484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.977554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.977732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.977829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.977874] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 705.982182] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.982312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.982489] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 562720b9-5307-4b2a-85ae-9454490a5827 with status ACTIVE [ 705.982647] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.982749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.982814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.982975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.983070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.983228] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.983318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.983377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.983518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.983594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.983765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.983856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.983917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.984068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.984141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.984529] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 562720b9-5307-4b2a-85ae-9454490a5827 is going to be updated. [ 705.988217] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.997601] env[65107]: INFO networking_nsxv3.common.synchronization [req-f5e5c126-f301-4fad-bac5-054e2e5d58f5 req-8a36e57a-267b-4698-b947-eec226836847 tempest-ServersWithSpecificFlavorTestJSON-1770061733 tempest-ServersWithSpecificFlavorTestJSON-1770061733-project-member] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 706.000063] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 706.000063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.000860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.000860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.001020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.001200] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.001290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.001353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.001519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.001677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.001767] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.007954] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.008090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.008159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.008468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.008468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.008657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-562720b9-5307-4b2a-85ae-9454490a5827" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.047455] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.047579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.047619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.048839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.048839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.064587] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 706.390045] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3940a6ac-eec0-4951-b1e8-dfe9ce6c8261 None None] Enqueued Resource ID: ac5fa089-3eae-490a-9535-ef6f976a8d30 with Priority: HIGHEST for action port [ 706.390727] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5fa089-3eae-490a-9535-ef6f976a8d30 with Priority: HIGHEST for action port [ 706.392105] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac5fa089-3eae-490a-9535-ef6f976a8d30 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.392252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac5fa089-3eae-490a-9535-ef6f976a8d30" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.392307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac5fa089-3eae-490a-9535-ef6f976a8d30" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.393146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac5fa089-3eae-490a-9535-ef6f976a8d30" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.393146] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac5fa089-3eae-490a-9535-ef6f976a8d30',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.475935] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-a45d05bb-9a6a-42ef-a009-98e10370a4a4 tempest-ListServersNegativeTestJSON-227968552 tempest-ListServersNegativeTestJSON-227968552-project-member] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 706.476703] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 706.476935] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.479646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.479646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.479724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.479849] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.479966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.480065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.480355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.480452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.480551] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.491326] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.503901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.504070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.504113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.504327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.504413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.504608] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.504711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.504773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.504923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.505025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.505119] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be updated. [ 706.533791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.533941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.534031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.534241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.534508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.545599] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: IN_PROGRESS for 2s [ 706.895421] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac5fa089-3eae-490a-9535-ef6f976a8d30 [ 706.895661] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.896531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.896531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.896531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.896531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.896531] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac5fa089-3eae-490a-9535-ef6f976a8d30 already deleted. [ 706.896531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac5fa089-3eae-490a-9535-ef6f976a8d30" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.983058] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.983373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.983373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.984027] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.984027] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.984183] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.984183] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.984359] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.984493] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.984685] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.984787] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.984887] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.984986] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.985096] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.985191] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.985311] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.986388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.986499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.986566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.986710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.986834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.986960] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.987065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.987122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.987258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.987330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.987409] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f already deleted. [ 706.987486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.994985] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.995142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.995179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.995352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.995434] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.995523] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 is going to be created. [ 707.011586] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.011586] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.011586] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.011586] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.011586] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.011586] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.011586] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.011852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.011943] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e13e5ac9-f6b8-45a8-af20-581d0372fa1f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.021538] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.021626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.021699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.022189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.022189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.036635] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 in Status: UNINITIALIZED for 2s [ 707.514384] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.514660] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.514812] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.516159] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.516159] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.516159] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port e13e5ac9-f6b8-45a8-af20-581d0372fa1f not found, creating... [ 707.516159] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.516356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.516356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.516640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.516882] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.517253] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.517494] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.517653] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.518017] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.518132] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.518280] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: e13e5ac9-f6b8-45a8-af20-581d0372fa1f is going to be created. [ 707.543049] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.543883] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.543883] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.544017] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.544262] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.544497] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.086392] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 708.086392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.347191] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-e821ec65-ca84-45f0-ad3d-a09e5bcf167d service nova] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_rules [ 708.347342] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-e821ec65-ca84-45f0-ad3d-a09e5bcf167d service nova] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 708.347474] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-e821ec65-ca84-45f0-ad3d-a09e5bcf167d service nova] Enqueued Resource ID: e13e5ac9-f6b8-45a8-af20-581d0372fa1f with Priority: HIGHEST for action port [ 708.347699] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_rules [ 708.347820] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 708.347910] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13e5ac9-f6b8-45a8-af20-581d0372fa1f with Priority: HIGHEST for action port [ 708.348574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.348756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.348756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.349294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.349294] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.350708] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.350708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.350708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.350932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.350998] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.351173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.351173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.351588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.351588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.351588] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.352417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.352559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.352612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.352860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.352860] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e13e5ac9-f6b8-45a8-af20-581d0372fa1f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.466512] env[65107]: INFO networking_nsxv3.common.synchronization [None req-bfa3a9dc-d2e7-4318-857c-fbafae4376e4 None None] Enqueued Resource ID: 1c96139a-92ee-416f-a42c-d77fb9a7420f with Priority: HIGHEST for action port [ 708.466512] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c96139a-92ee-416f-a42c-d77fb9a7420f with Priority: HIGHEST for action port [ 708.466512] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c96139a-92ee-416f-a42c-d77fb9a7420f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.466512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c96139a-92ee-416f-a42c-d77fb9a7420f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.466512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c96139a-92ee-416f-a42c-d77fb9a7420f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.466512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c96139a-92ee-416f-a42c-d77fb9a7420f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.466512] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c96139a-92ee-416f-a42c-d77fb9a7420f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.559604] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 708.559720] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 deletion is rescheduled due to dependency. [ 708.560662] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.770889] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-1c0e5b16-475d-460c-a3bb-9260c6aed32f tempest-ListServersNegativeTestJSON-227968552 tempest-ListServersNegativeTestJSON-227968552-project-member] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 708.771497] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 708.772341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.772496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.856119] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.857456] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.857895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.858992] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e13e5ac9-f6b8-45a8-af20-581d0372fa1f with status ACTIVE [ 708.858992] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.858992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.860387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.860387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.860387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.860387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.860387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.860387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.860387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.860687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.860935] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.861498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.864315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.864772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.866436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.866436] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e13e5ac9-f6b8-45a8-af20-581d0372fa1f is going to be updated. [ 708.894423] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.894423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.894423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.894423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.894423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.894766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e13e5ac9-f6b8-45a8-af20-581d0372fa1f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.970430] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c96139a-92ee-416f-a42c-d77fb9a7420f [ 708.970430] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.970430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.970430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.970430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.970430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.970430] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c96139a-92ee-416f-a42c-d77fb9a7420f already deleted. [ 708.970430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c96139a-92ee-416f-a42c-d77fb9a7420f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.048429] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 in Status: SUCCESS [ 709.048763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.050199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.050472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.050723] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.050847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.050911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.051089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.051171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.051256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.051346] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.251195] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.251482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.251552] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.252060] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.252302] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.252471] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.252584] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.252805] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.252945] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.253187] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.253430] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.253516] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.253656] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.253769] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.253868] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.254027] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.278299] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.278490] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.278624] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.278881] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.279385] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.279675] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.279829] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.280319] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.280460] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c391d9b-43e6-4ef1-b7da-55ec7bea715a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.358963] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.380221] env[65107]: INFO networking_nsxv3.common.synchronization [None req-09f0bcd0-0a02-4329-b179-ba6e9a22dc3a None None] Enqueued Resource ID: 567e37a4-0046-415a-a9b2-5c2589ac7125 with Priority: HIGHEST for action port [ 709.381172] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 567e37a4-0046-415a-a9b2-5c2589ac7125 with Priority: HIGHEST for action port [ 709.385023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-567e37a4-0046-415a-a9b2-5c2589ac7125 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.385023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-567e37a4-0046-415a-a9b2-5c2589ac7125" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.385023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-567e37a4-0046-415a-a9b2-5c2589ac7125" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.385023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-567e37a4-0046-415a-a9b2-5c2589ac7125" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.385023] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('567e37a4-0046-415a-a9b2-5c2589ac7125',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.554932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.558424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.558424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.558424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.558424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.558993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.558993] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.783769] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.784165] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.784353] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.784825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.785071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.785249] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 1c391d9b-43e6-4ef1-b7da-55ec7bea715a not found, creating... [ 709.785592] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.785839] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.785971] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.786480] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.786703] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.787103] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.787475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.787638] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.787961] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.788151] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.788462] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 1c391d9b-43e6-4ef1-b7da-55ec7bea715a is going to be created. [ 709.826500] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.826854] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.826933] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.827358] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.827614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.827922] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.862448] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.862448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.862852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.863228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.863596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.863809] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be created. [ 709.886115] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 567e37a4-0046-415a-a9b2-5c2589ac7125 [ 709.886517] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.886696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.886800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.887764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.887764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.887764] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:567e37a4-0046-415a-a9b2-5c2589ac7125 already deleted. [ 709.887764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-567e37a4-0046-415a-a9b2-5c2589ac7125" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.911390] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.911390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.911390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.911390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.911390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.924594] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: UNINITIALIZED for 2s [ 710.062298] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80897378-8bb7-4165-aca0-4e8d0e40ed38: rpc.has_security_group_logging(os_id): False [ 710.082784] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.083121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.083121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.083267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.083376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.083720] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.083844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.083909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.084130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.084216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.084422] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.084524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.084589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.084776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.084882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.085159] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.085307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.085392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.085552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.085625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.085759] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 is going to be created. [ 710.161817] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.161971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.162073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.162295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.162467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.173252] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 in Status: IN_PROGRESS for 2s [ 710.567403] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-8bd06be8-7d71-4082-96e7-e0e0c48482a0 service nova] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_rules [ 710.567628] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-8bd06be8-7d71-4082-96e7-e0e0c48482a0 service nova] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 710.567793] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-8bd06be8-7d71-4082-96e7-e0e0c48482a0 service nova] Enqueued Resource ID: 1c391d9b-43e6-4ef1-b7da-55ec7bea715a with Priority: HIGHEST for action port [ 710.568406] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_rules [ 710.568565] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 710.568651] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c391d9b-43e6-4ef1-b7da-55ec7bea715a with Priority: HIGHEST for action port [ 710.569038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.569127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.569405] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.569505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.570175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.570306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.570380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.570575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.570656] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c391d9b-43e6-4ef1-b7da-55ec7bea715a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.793969] env[65107]: INFO networking_nsxv3.common.synchronization [req-a16dbf2e-0a15-40e5-b940-0b9e1ff128cd req-ec8614ef-f8ba-4796-9d74-388331024c0a tempest-ServerMetadataNegativeTestJSON-1601808360 tempest-ServerMetadataNegativeTestJSON-1601808360-project-member] Enqueued Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_members [ 710.794574] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGHEST for action security_group_members [ 710.795102] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.795844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.795943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.796160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.796326] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.796431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.796488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.796628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.796714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.796807] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.072770] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c391d9b-43e6-4ef1-b7da-55ec7bea715a with status ACTIVE [ 711.073157] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.073276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.073276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.073568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.073568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.074033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.074033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.074033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.074196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.074232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.074409] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.074512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.074554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.074684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.074754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.074835] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c391d9b-43e6-4ef1-b7da-55ec7bea715a is going to be updated. [ 711.094357] env[65107]: INFO networking_nsxv3.common.synchronization [None req-b2f66c46-e6ef-4ea6-af37-fe4c2076e61a tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_rules [ 711.102671] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_rules [ 711.102671] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.102671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.102671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.102671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.102671] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.102671] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.102671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.103175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.103175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.103175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.103509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c391d9b-43e6-4ef1-b7da-55ec7bea715a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.301873] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.301873] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.301873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.301873] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c78203ee-b32f-401b-9764-682ada8423c6 is going to be updated. [ 711.321664] env[65107]: INFO networking_nsxv3.common.synchronization [None req-89eddafc-de8e-4a44-9aab-c17049de5cba tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_rules [ 711.322161] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_rules [ 711.329409] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.330748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.351071] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.351071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.351071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.351260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.351388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.362820] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c78203ee-b32f-401b-9764-682ada8423c6 in Status: IN_PROGRESS for 2s [ 711.623405] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.623711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.623711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.623826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.623916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.624017] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 already deleted. [ 711.624101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.624254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.624406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.624488] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.692598] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-5585fad3-3288-4be8-b15f-93fb91fe8820 tempest-ListServersNegativeTestJSON-227968552 tempest-ListServersNegativeTestJSON-227968552-project-member] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 711.696805] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 711.696805] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.696805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.934333] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 711.934406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.934613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.934780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.934974] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.935098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.935168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.935321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.935403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.935499] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.104019] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.104019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.104019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.104019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.104019] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.104019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.107973] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.107973] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.107973] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.107973] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.107973] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.107973] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.107973] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.107973] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.107973] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.107973] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.125743] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.125981] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.126210] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.126678] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-160" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.126933] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-b89fe13f-5ec5-4fef-990d-42f45de185c7 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.127223] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.127439] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.127754] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.127957] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89fe13f-5ec5-4fef-990d-42f45de185c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.147844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.148858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.148858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.148858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.148858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.148858] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 already deleted. [ 712.148858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.189539] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 in Status: SUCCESS [ 712.190177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.440131] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.630793] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.631199] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.631199] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.631414] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.631560] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.631705] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port b89fe13f-5ec5-4fef-990d-42f45de185c7 not found, creating... [ 712.631952] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.632114] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.632253] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.632429] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.632550] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.632811] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.632954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.633082] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.633278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.633445] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.633605] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: b89fe13f-5ec5-4fef-990d-42f45de185c7 is going to be created. [ 712.655958] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.656184] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.656275] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.656530] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.656749] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.656974] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.948143] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.374967] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c78203ee-b32f-401b-9764-682ada8423c6 in Status: SUCCESS [ 713.375190] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c78203ee-b32f-401b-9764-682ada8423c6 deletion is rescheduled due to dependency. [ 713.375311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.429826] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-a35aa216-84f5-4699-b2c9-13171784229d service nova] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_rules [ 713.429826] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-a35aa216-84f5-4699-b2c9-13171784229d service nova] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 713.430315] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ae905d1-30c2-4821-8586-155c33961ef4 req-a35aa216-84f5-4699-b2c9-13171784229d service nova] Enqueued Resource ID: b89fe13f-5ec5-4fef-990d-42f45de185c7 with Priority: HIGHEST for action port [ 713.430825] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_rules [ 713.431036] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 713.431188] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89fe13f-5ec5-4fef-990d-42f45de185c7 with Priority: HIGHEST for action port [ 713.432266] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.432266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.432266] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.432812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.432812] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b89fe13f-5ec5-4fef-990d-42f45de185c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.433967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.433967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.433967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.433967] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89fe13f-5ec5-4fef-990d-42f45de185c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.450581] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.450581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.450817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.452336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.452472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.452697] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 713.510483] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.510766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.510766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.511013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.511171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.524992] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 713.936178] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b89fe13f-5ec5-4fef-990d-42f45de185c7 with status ACTIVE [ 713.936618] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.936618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.936618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.937247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.937247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.937532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.937532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.937532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.937778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.937778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.937933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.938056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.938114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.938253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.938326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.938407] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b89fe13f-5ec5-4fef-990d-42f45de185c7 is going to be updated. [ 713.967057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.967240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.967313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.967564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.967705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.967885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b89fe13f-5ec5-4fef-990d-42f45de185c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.277619] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7799e86e-b6d5-49c5-8ced-8f7c461afd3f None None] Enqueued Resource ID: 9fefce04-1b4a-4f49-a69c-822497abc8df with Priority: HIGHEST for action port [ 714.277854] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fefce04-1b4a-4f49-a69c-822497abc8df with Priority: HIGHEST for action port [ 714.278959] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fefce04-1b4a-4f49-a69c-822497abc8df taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.278959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fefce04-1b4a-4f49-a69c-822497abc8df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.278959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fefce04-1b4a-4f49-a69c-822497abc8df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.280091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fefce04-1b4a-4f49-a69c-822497abc8df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.280091] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fefce04-1b4a-4f49-a69c-822497abc8df',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.788821] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fefce04-1b4a-4f49-a69c-822497abc8df [ 714.789123] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.789257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.789313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.789603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.789709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.789806] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fefce04-1b4a-4f49-a69c-822497abc8df already deleted. [ 714.789899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fefce04-1b4a-4f49-a69c-822497abc8df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.538213] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 715.538609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.538713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.538922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.539263] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.540809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.540809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.540809] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.545117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.545247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.545522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.545522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.546120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.546120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.546120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.546120] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.048407] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.048407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.055528] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.559373] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.864066] env[65107]: INFO networking_nsxv3.common.synchronization [req-96f14b78-125b-49d3-b084-7f88d178252d req-4a6c47eb-c5ec-43a9-9826-2f635df4ebb8 tempest-ServersTestFqdnHostnames-2005309367 tempest-ServersTestFqdnHostnames-2005309367-project-member] Enqueued Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_members [ 716.865287] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_members [ 716.865681] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.865846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.865963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.866274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.867076] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.867076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.867076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.870601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.870601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.870601] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.031226] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e2fea5aa-5bdc-4dd0-8b88-d58b6ef0e504 tempest-ServersTestBootFromVolume-1621330954 tempest-ServersTestBootFromVolume-1621330954-project-member] Enqueued Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_rules [ 717.031623] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_rules [ 717.032246] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.035523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.035708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.036122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.036122] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.062129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.062318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.062367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.062603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.062710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.062822] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 717.102815] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.102815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.102815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.102815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.102815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.116963] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 717.268559] env[65107]: INFO networking_nsxv3.common.synchronization [None req-70be13c0-75d4-4a76-b390-72607da5e4f0 tempest-ServersTestBootFromVolume-1621330954 tempest-ServersTestBootFromVolume-1621330954-project-member] Enqueued Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_rules [ 717.268957] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_rules [ 717.269389] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.269494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.374910] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.374910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.374910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.374910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.374910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.374910] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.374910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.375478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.375478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.375538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.375727] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 already deleted. [ 717.379042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.525210] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.525407] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-893" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.525536] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-893" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.525935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-893" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.526227] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.526485] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.526631] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.526829] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.526985] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.527193] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.527302] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.527406] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.527507] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.527629] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.527737] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.527864] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.556104] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.556104] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.556104] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.556104] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-893" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.556288] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-f094454b-a5fe-495c-9928-d9a12cf8b9b9 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.556433] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.556556] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.557019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.557355] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f094454b-a5fe-495c-9928-d9a12cf8b9b9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.562289] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.562289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.562289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.562289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.563053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.563053] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 already deleted. [ 717.563053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.563053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.563963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.563963] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.665297] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7504c059-75a3-4572-9978-b4b028dd47e8 None None] Enqueued Resource ID: 70a2fe42-fe52-4f0e-a8c1-2fda5899eed3 with Priority: HIGHEST for action port [ 717.665815] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70a2fe42-fe52-4f0e-a8c1-2fda5899eed3 with Priority: HIGHEST for action port [ 717.666228] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-70a2fe42-fe52-4f0e-a8c1-2fda5899eed3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.666578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70a2fe42-fe52-4f0e-a8c1-2fda5899eed3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.666651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70a2fe42-fe52-4f0e-a8c1-2fda5899eed3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.666907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70a2fe42-fe52-4f0e-a8c1-2fda5899eed3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.667057] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70a2fe42-fe52-4f0e-a8c1-2fda5899eed3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.065712] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.066080] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.066293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.066689] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.066914] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.067155] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port f094454b-a5fe-495c-9928-d9a12cf8b9b9 not found, creating... [ 718.067440] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.067598] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.067713] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.067937] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.068092] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.068395] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.068543] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.068654] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.068856] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.068984] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.069166] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: f094454b-a5fe-495c-9928-d9a12cf8b9b9 is going to be created. [ 718.091476] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.091683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.091683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.091919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.092153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.092305] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 already deleted. [ 718.092447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.094581] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.094790] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.094899] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.095224] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.095463] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.095683] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.169058] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70a2fe42-fe52-4f0e-a8c1-2fda5899eed3 [ 718.169532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.169763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.169896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.170568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.170770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.170895] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70a2fe42-fe52-4f0e-a8c1-2fda5899eed3 already deleted. [ 718.171110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70a2fe42-fe52-4f0e-a8c1-2fda5899eed3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.867588] env[65107]: INFO networking_nsxv3.common.synchronization [req-96f14b78-125b-49d3-b084-7f88d178252d req-f0bdcc0b-e5a9-4bab-8d7b-3f250f13812a service nova] Enqueued Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_rules [ 718.868849] env[65107]: INFO networking_nsxv3.common.synchronization [req-96f14b78-125b-49d3-b084-7f88d178252d req-f0bdcc0b-e5a9-4bab-8d7b-3f250f13812a service nova] Enqueued Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_members [ 718.869190] env[65107]: INFO networking_nsxv3.common.synchronization [req-96f14b78-125b-49d3-b084-7f88d178252d req-f0bdcc0b-e5a9-4bab-8d7b-3f250f13812a service nova] Enqueued Resource ID: f094454b-a5fe-495c-9928-d9a12cf8b9b9 with Priority: HIGHEST for action port [ 718.869893] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_rules [ 718.870106] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_members [ 718.870252] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f094454b-a5fe-495c-9928-d9a12cf8b9b9 with Priority: HIGHEST for action port [ 718.870712] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.870874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.874786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.875123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.875782] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.876431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.876635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.876749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.877024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.877303] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.877467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.877576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.877813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.877970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.879099] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.881959] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f094454b-a5fe-495c-9928-d9a12cf8b9b9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.881959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.881959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.881959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.881959] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f094454b-a5fe-495c-9928-d9a12cf8b9b9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.133224] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 719.133224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.133224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.133224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.133524] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.133785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.134775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.134775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.134775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.134775] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.385027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.385027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.385027] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.385027] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f094454b-a5fe-495c-9928-d9a12cf8b9b9 with status ACTIVE [ 719.385027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.385027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.385027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.385027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.385027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.386477] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.386829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.387641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.387995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.388255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.388662] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.388943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.389293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.389933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.389933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.390601] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f094454b-a5fe-495c-9928-d9a12cf8b9b9 is going to be updated. [ 719.420167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.420167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.420167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.420167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.420167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.420167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f094454b-a5fe-495c-9928-d9a12cf8b9b9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.638990] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.893593] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.939809] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f1f7d849-a344-4ba0-b16f-3a428fe777ec None None] Enqueued Resource ID: 47ed1519-dd0c-45fb-bffd-5527bb450e7e with Priority: HIGHEST for action port [ 719.939996] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ed1519-dd0c-45fb-bffd-5527bb450e7e with Priority: HIGHEST for action port [ 719.940572] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-47ed1519-dd0c-45fb-bffd-5527bb450e7e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.940784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47ed1519-dd0c-45fb-bffd-5527bb450e7e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.940889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47ed1519-dd0c-45fb-bffd-5527bb450e7e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.941224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47ed1519-dd0c-45fb-bffd-5527bb450e7e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.941384] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47ed1519-dd0c-45fb-bffd-5527bb450e7e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.143358] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.397111] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.397816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.397816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.398167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.398167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.398258] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 is going to be created. [ 720.425055] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.425314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.425314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.425531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.425695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.439391] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 in Status: UNINITIALIZED for 2s [ 720.446032] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47ed1519-dd0c-45fb-bffd-5527bb450e7e [ 720.446135] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.446256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.446323] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.446549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.446636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.446729] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47ed1519-dd0c-45fb-bffd-5527bb450e7e already deleted. [ 720.446811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47ed1519-dd0c-45fb-bffd-5527bb450e7e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.648539] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.648682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.648735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.649711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.649711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.649711] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 720.689022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.689022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.689022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.689022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.689022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.708119] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 722.452179] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 in Status: SUCCESS [ 722.453163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.453163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.453163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.453503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.455282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.455371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.455603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.455699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.455796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.455905] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.722269] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 722.722269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.722269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.722464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.722647] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.722755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.722863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.722955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.723040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.723134] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.766387] env[65107]: INFO networking_nsxv3.common.synchronization [req-da50c269-5973-401a-8e43-c3398ffe4a8d req-149d8103-1430-4a3d-a9d1-36b0bef5bdec tempest-ServersAdminNegativeTestJSON-1455848825 tempest-ServersAdminNegativeTestJSON-1455848825-project-member] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 722.766994] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 722.767943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.767943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.767943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.767943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.767943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.768236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.768236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.768611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.768611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.768611] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.958713] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.182698] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e0975e12-7c90-4877-a529-ad665911db1d None None] Enqueued Resource ID: 871d3282-babb-434b-a54d-cc6fa7b2e414 with Priority: HIGHEST for action port [ 723.183457] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 871d3282-babb-434b-a54d-cc6fa7b2e414 with Priority: HIGHEST for action port [ 723.183859] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-871d3282-babb-434b-a54d-cc6fa7b2e414 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.183998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-871d3282-babb-434b-a54d-cc6fa7b2e414" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.184108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-871d3282-babb-434b-a54d-cc6fa7b2e414" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.184449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-871d3282-babb-434b-a54d-cc6fa7b2e414" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.184538] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('871d3282-babb-434b-a54d-cc6fa7b2e414',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.227062] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.270496] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.461296] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44ae0e63-5c9b-464b-a6dd-e9e056e17006: rpc.has_security_group_logging(os_id): False [ 723.481492] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.481782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.481893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.482205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.482312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482734] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.482734] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.482734] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.482960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.482996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.483100] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 is going to be created. [ 723.551576] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.551576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.551576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.551576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.551576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.566511] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 in Status: IN_PROGRESS for 2s [ 723.688525] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 871d3282-babb-434b-a54d-cc6fa7b2e414 [ 723.688897] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.689043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.689043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.689397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.689530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.689658] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:871d3282-babb-434b-a54d-cc6fa7b2e414 already deleted. [ 723.689782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-871d3282-babb-434b-a54d-cc6fa7b2e414" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.733668] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.772648] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.237070] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.237287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.237287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.237465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.237565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.237664] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 724.274820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.275077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.275077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.275297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.275444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.276665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.276892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.276892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.277027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.277112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.277220] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be updated. [ 724.313770] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 724.339459] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.339459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.339459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.339762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.339841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.357044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: IN_PROGRESS for 2s [ 725.580584] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 in Status: SUCCESS [ 725.580584] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.325584] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 726.325836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.326076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.326594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.326594] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.326742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.326780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.326966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.327074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.327175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.327350] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.327455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.327686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.327686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.327810] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.328563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.328563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.328563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.328563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.328563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.328563] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.371377] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: SUCCESS [ 726.371880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.831827] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e345bd-70c9-42fe-b74a-676b7bf1ce7f: rpc.has_security_group_logging(os_id): False [ 726.852461] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.852705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.852756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.853083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.853144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.853382] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.853499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.853575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.853743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.853811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.854019] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.854116] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.854176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.854322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.854418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.854604] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.854688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.854740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.854878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.854984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.855119] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be created. [ 726.927814] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.928072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.928159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.928540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.928792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.942899] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 728.184731] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 728.184731] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 728.775823] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-8cde7b98-0491-4189-a244-9747518ed7d5 tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 728.776506] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 728.777361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.777523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.777585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.777831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.778035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.778151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.778213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.778448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.778448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.778568] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.956939] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 728.957810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.957810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.957951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.958080] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.096589] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-465c29be-f83e-43c6-be8c-e27347363cd0 tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 729.098412] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 729.099056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.099611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.282639] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.282639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.282639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.283261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.283261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.283370] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.283619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.283788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.284181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.284181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.284462] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 729.320488] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.320754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.320858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.321092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.321244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.332568] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 729.461189] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.461509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.461509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.462163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.462163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.462163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.462163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.462373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.463054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.463054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.463054] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.533949] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.534312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-133" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.534536] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-133" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.534897] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-133" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.535243] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.535523] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.535726] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.536594] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.536836] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.537194] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.537334] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.537485] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.537630] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.537783] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.537914] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.538102] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.558220] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.558508] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.558701] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.558929] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-133" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.559380] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-21a6624b-33f5-41b1-8da0-bc91348a0306 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.559693] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.559825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.560205] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.560378] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21a6624b-33f5-41b1-8da0-bc91348a0306',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.964481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.964827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.964827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.965125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.965369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.965448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.965489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.965651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.965730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.965806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.965956] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.966096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.966322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.966322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.966506] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.966610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.966667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.966831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.967121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.967121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.967121] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.063248] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.063542] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.063667] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.063941] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.064269] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.064269] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 21a6624b-33f5-41b1-8da0-bc91348a0306 not found, creating... [ 730.064543] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.064696] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.064805] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.065075] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.065207] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.065520] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.065730] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.065801] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.065974] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.066123] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.066587] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 21a6624b-33f5-41b1-8da0-bc91348a0306 is going to be created. [ 730.096041] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.096339] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.096441] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.096722] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.097438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.097600] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.470422] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e345bd-70c9-42fe-b74a-676b7bf1ce7f: rpc.has_security_group_logging(os_id): False [ 730.489519] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.489621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.489697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.489971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.490172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.490541] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.490668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.490668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.490890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.491023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.491205] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.491325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.491404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.491578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.491665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.492052] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.492052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.492181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.492216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.492293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.492392] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 730.562279] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.562506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.562506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.562730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.562879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.576497] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 730.843207] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-2de1034a-58e2-4543-aff1-71cc060bf14a service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 730.843207] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-2de1034a-58e2-4543-aff1-71cc060bf14a service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 730.843207] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-2de1034a-58e2-4543-aff1-71cc060bf14a service nova] Enqueued Resource ID: 21a6624b-33f5-41b1-8da0-bc91348a0306 with Priority: HIGHEST for action port [ 730.843207] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 730.843207] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 730.843207] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a6624b-33f5-41b1-8da0-bc91348a0306 with Priority: HIGHEST for action port [ 730.843207] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.843207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.843207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.846712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.847014] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.854358] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.854358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.854358] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-21a6624b-33f5-41b1-8da0-bc91348a0306 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.854358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.854358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.854358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.854358] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21a6624b-33f5-41b1-8da0-bc91348a0306',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.349458] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 731.349668] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd deletion is rescheduled due to dependency. [ 731.349814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.349993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.350343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.350602] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.350865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.350946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.351355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.351978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.352244] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.356703] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.357008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.357885] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21a6624b-33f5-41b1-8da0-bc91348a0306 with status ACTIVE [ 731.358580] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.358960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.359320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.359646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.359803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.360365] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.360750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.360903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.361195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.361374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.361697] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.361850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.361965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.362460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.362626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.362763] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21a6624b-33f5-41b1-8da0-bc91348a0306 is going to be updated. [ 731.390646] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.390646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.390646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.390646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.390942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.391173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21a6624b-33f5-41b1-8da0-bc91348a0306" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.705878] env[65107]: INFO networking_nsxv3.common.synchronization [req-5d7eed73-252d-4370-82e4-eb4b35952f4a req-97735340-76b3-4256-95e6-02401e50dfb4 tempest-FloatingIPsAssociationTestJSON-90781303 tempest-FloatingIPsAssociationTestJSON-90781303-project-member] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 731.707029] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 731.707029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.707029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.707029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.708304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.712262] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.712411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.712481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.712687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.712780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.712882] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.860588] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.067129] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.067340] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-425" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.067478] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-425" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.067845] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-425" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.068206] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.068407] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.068526] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.068750] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.068905] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.069139] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.069272] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.069406] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.069481] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.069622] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.069691] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.070948] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.094251] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.094413] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.094561] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.094759] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-425" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.095184] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.095374] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.095506] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.095819] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.095968] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.215905] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.363196] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.427036] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.427388] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.427525] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.427816] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.428117] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.428306] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.428438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.428660] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.428797] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.428993] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.429131] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.429223] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.429342] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.429449] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.429580] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.429725] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.448241] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.448403] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.448541] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.448714] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-722" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.449023] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-5ff3d46b-cbf2-458c-a520-cc05975efb0c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.449191] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.449400] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.449804] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.449994] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff3d46b-cbf2-458c-a520-cc05975efb0c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.590382] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 732.590669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.590861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.591094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.591186] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.598487] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.598707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.598824] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.599115] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.599313] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.599463] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 not found, creating... [ 732.599753] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.599920] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.600060] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.600339] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.600490] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.600804] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.600958] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.601082] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.601293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.601421] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.601591] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 is going to be created. [ 732.622759] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.623235] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.623235] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.623365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.623583] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.623802] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.717542] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.865291] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.865527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.865576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.865818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.865937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.866086] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 732.893294] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.893494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.893533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.893743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.893881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.903687] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 732.952622] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.952877] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.952979] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.953264] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.953448] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.953605] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 5ff3d46b-cbf2-458c-a520-cc05975efb0c not found, creating... [ 732.953941] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.954113] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.954223] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.954434] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.954566] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.954837] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.954984] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.955160] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.955295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.955418] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.955548] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 5ff3d46b-cbf2-458c-a520-cc05975efb0c is going to be created. [ 732.976403] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.976615] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.976770] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.976933] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.977291] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.977603] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.093214] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.093426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.093477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.093733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.093982] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.094122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.094190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.094357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.094447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.094597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.094718] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.222048] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.222048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.222048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.222235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.222235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.222307] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be updated. [ 733.253301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.253558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.253558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.253739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.253872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.265060] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 2s [ 733.363874] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-db606644-24c9-400f-a76b-fd424054c087 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 733.364117] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-db606644-24c9-400f-a76b-fd424054c087 service nova] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 733.364340] env[65107]: INFO networking_nsxv3.common.synchronization [req-69a25f7b-ded2-4e6f-b5d6-18ffeb2c358e req-db606644-24c9-400f-a76b-fd424054c087 service nova] Enqueued Resource ID: 2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 with Priority: HIGHEST for action port [ 733.365105] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_rules [ 733.365287] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 733.365424] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 with Priority: HIGHEST for action port [ 733.365823] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.365987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.367083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.367368] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.367512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.367594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.367806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.368190] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.597030] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.597275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.597332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.597632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.597859] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.598011] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.598058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.598243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.599062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.599062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.599062] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.599062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.599062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.599062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.599337] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.599337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.599452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.599564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.599670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.599788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.599930] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.704986] env[65107]: INFO networking_nsxv3.common.synchronization [req-5d7eed73-252d-4370-82e4-eb4b35952f4a req-536fd0bf-e58b-4734-8d38-cf9568193ab5 service nova] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_rules [ 733.705200] env[65107]: INFO networking_nsxv3.common.synchronization [req-5d7eed73-252d-4370-82e4-eb4b35952f4a req-536fd0bf-e58b-4734-8d38-cf9568193ab5 service nova] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 733.705336] env[65107]: INFO networking_nsxv3.common.synchronization [req-5d7eed73-252d-4370-82e4-eb4b35952f4a req-536fd0bf-e58b-4734-8d38-cf9568193ab5 service nova] Enqueued Resource ID: 5ff3d46b-cbf2-458c-a520-cc05975efb0c with Priority: HIGHEST for action port [ 733.705871] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_rules [ 733.706209] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 733.706410] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ff3d46b-cbf2-458c-a520-cc05975efb0c with Priority: HIGHEST for action port [ 733.706672] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.706811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.706878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.707106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.707221] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.709338] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.709835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.710765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ff3d46b-cbf2-458c-a520-cc05975efb0c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.710765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.710765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.710765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.711183] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff3d46b-cbf2-458c-a520-cc05975efb0c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.870617] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 with status ACTIVE [ 733.870918] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.870982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.871062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.874436] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.874436] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.874436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.874436] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2 is going to be updated. [ 733.908890] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.909142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.909322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.909538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.909782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.909938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d0b50a2-1ac9-4a9f-b8c6-8bbeed9443d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.103454] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e345bd-70c9-42fe-b74a-676b7bf1ce7f: rpc.has_security_group_logging(os_id): False [ 734.124297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.124297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.124297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.124297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.124297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.124297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.124297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.124588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.124588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.124588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.124853] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.124853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.124988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.125034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.125095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.125332] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.125410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.125509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.125694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.125749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.125796] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 734.195510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.196887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.196887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.196887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.196887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.211389] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 734.212882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.212962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.216478] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ff3d46b-cbf2-458c-a520-cc05975efb0c with status ACTIVE [ 734.216678] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.216805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.216874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.217105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.217197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.217397] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.217495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.217559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.217716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.217793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.217975] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.218081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.218142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.218276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.218369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.218458] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ff3d46b-cbf2-458c-a520-cc05975efb0c is going to be updated. [ 734.239822] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.240021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.240152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.240420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.240611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.240820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ff3d46b-cbf2-458c-a520-cc05975efb0c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.915662] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 734.916222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.916757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.917078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.917367] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.917574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.917722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.917951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.918138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.918323] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.277441] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 4s [ 735.423731] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.601506] env[65107]: INFO networking_nsxv3.common.synchronization [req-5c4072bf-2153-4d3e-b21e-374300c9538f req-e40aafe7-aee4-4e76-8c27-caa6101e9317 tempest-ServersTestJSON-844015729 tempest-ServersTestJSON-844015729-project-member] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_members [ 735.604983] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_members [ 735.604983] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.604983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.604983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.604983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.604983] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.604983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.604983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.604983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.604983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.604983] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.925195] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.071419] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.071646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.071798] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.072134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.072538] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.072538] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.072743] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.073043] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.073207] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.073427] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.073596] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.073740] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.073881] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.073971] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.074069] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.074195] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.094594] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.094882] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.095112] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.095390] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-183" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.095841] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-a8ffed60-8871-49ff-8c43-b02281827b1c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.096112] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.096295] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.096717] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.096922] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8ffed60-8871-49ff-8c43-b02281827b1c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.107850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.108099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.108349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.109226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.109226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.109603] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.110969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.110969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.110969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.110969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.110969] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b already deleted. [ 736.110969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.226854] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 736.226854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.429555] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.429659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.429659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.429974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.429974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.430409] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 736.461771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.461930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.462037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.462265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.462556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.474981] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 736.599794] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.600044] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.600193] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.600551] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.600722] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.600889] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port a8ffed60-8871-49ff-8c43-b02281827b1c not found, creating... [ 736.601223] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.601401] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.601535] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.601872] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.602038] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.602383] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.602569] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.602685] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.602932] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.603898] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.603898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: a8ffed60-8871-49ff-8c43-b02281827b1c is going to be created. [ 736.625808] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.626110] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.626302] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.626516] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.626765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.627040] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.289731] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 737.289980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.290250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.290365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.290548] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.290660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.290724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.291839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.292048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.292159] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.365778] env[65107]: INFO networking_nsxv3.common.synchronization [req-5c4072bf-2153-4d3e-b21e-374300c9538f req-218fc1ab-9033-40e5-b7a3-09550c428ae8 service nova] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_rules [ 737.365884] env[65107]: INFO networking_nsxv3.common.synchronization [req-5c4072bf-2153-4d3e-b21e-374300c9538f req-218fc1ab-9033-40e5-b7a3-09550c428ae8 service nova] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_members [ 737.365983] env[65107]: INFO networking_nsxv3.common.synchronization [req-5c4072bf-2153-4d3e-b21e-374300c9538f req-218fc1ab-9033-40e5-b7a3-09550c428ae8 service nova] Enqueued Resource ID: a8ffed60-8871-49ff-8c43-b02281827b1c with Priority: HIGHEST for action port [ 737.366236] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_rules [ 737.366364] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_members [ 737.366529] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ffed60-8871-49ff-8c43-b02281827b1c with Priority: HIGHEST for action port [ 737.367683] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.367816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.367873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.368177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.368177] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.369020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.369119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.369212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.369558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.369558] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.369686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.369686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.369775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.370185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.370185] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.370676] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8ffed60-8871-49ff-8c43-b02281827b1c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.370790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.370850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.371189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.371189] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8ffed60-8871-49ff-8c43-b02281827b1c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.792694] env[65107]: INFO networking_nsxv3.common.synchronization [req-20b74830-5c24-4d0e-8cb9-858bc17e66c1 req-1053c0e6-83cd-47d7-a92b-b6274f609d88 tempest-ServersV294TestFqdnHostnames-382574538 tempest-ServersV294TestFqdnHostnames-382574538-project-member] Enqueued Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_members [ 737.793807] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGHEST for action security_group_members [ 737.795080] env[65107]: INFO networking_nsxv3.common.synchronization [req-e52fa2c0-d24b-4a64-ab3d-70024ffa496f req-c71a9751-5fb8-48b4-9a03-d8d71cda0c2d tempest-FloatingIPsAssociationNegativeTestJSON-668852265 tempest-FloatingIPsAssociationNegativeTestJSON-668852265-project-member] Enqueued Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_members [ 737.795080] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.796493] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.796493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.796493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.796673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.797294] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.797294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.797294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.797452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.797494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.797597] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.798922] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGHEST for action security_group_members [ 737.799212] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.799541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.799541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.799651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.799741] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.799839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.799900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.800142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.800259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.800378] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.872551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.872551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.873221] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.873608] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8ffed60-8871-49ff-8c43-b02281827b1c with status ACTIVE [ 737.873797] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.874257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.874257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.874257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.874257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.874458] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.874507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.874672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.874712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.874772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.874945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.875844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.876068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.876457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.876457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.876457] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8ffed60-8871-49ff-8c43-b02281827b1c is going to be updated. [ 737.899026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.899182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.899241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.899510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.899648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.900252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8ffed60-8871-49ff-8c43-b02281827b1c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.112641] env[65107]: INFO networking_nsxv3.common.synchronization [req-747e4d33-3c3a-4d83-afce-e255954b5bd3 req-e8367e10-7911-4e18-8c85-aabb1ee786d4 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 738.113043] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 738.113448] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.113588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.113695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.113850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.114017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.114119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.114176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.114413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.114526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.114623] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.297466] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.299840] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.299840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.299840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.299840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.299840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.301503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.301503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.301503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.301503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.301503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.301503] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 is going to be updated. [ 738.302981] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.302981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.302981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.304060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.304060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.304060] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.304060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.304060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.304060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.306179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.306179] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a469b2f-9178-42b0-be36-f1370374e744 is going to be updated. [ 738.353515] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.353515] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.353515] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.354014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.354242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.356609] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.356991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.357312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.357481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.357664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.378531] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.391404] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a469b2f-9178-42b0-be36-f1370374e744 in Status: IN_PROGRESS for 2s [ 738.392423] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 in Status: IN_PROGRESS for 2s [ 738.487297] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 738.487636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.487830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.487991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.488241] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.488325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.488394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.488718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.488718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.488718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.488820] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.489746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.489918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.491406] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.492251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.492251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.492251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.492251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.492251] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.616840] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.803771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.803771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.803771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.803771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.804232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.804540] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be updated. [ 738.842096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.842096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.842096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.842096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.842399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.860165] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 2s [ 738.882844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.882844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.882844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.882844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.882844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.882844] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b is going to be created. [ 738.911617] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.911812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.911861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.912082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.912241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.929053] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: UNINITIALIZED for 2s [ 738.980400] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.980599] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.980762] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.980970] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.981242] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.981390] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.981499] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.981706] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.981843] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.983591] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.983591] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.983843] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.983843] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.983947] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.983996] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.984120] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.994528] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.994786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.995050] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.008773] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.008966] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.009189] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.009685] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-758" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.009904] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-b09350fa-f4ff-42b3-9406-b9f4595ecdea taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.010157] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.010342] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.010762] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.010947] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09350fa-f4ff-42b3-9406-b9f4595ecdea',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.119707] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.271165] env[65107]: INFO networking_nsxv3.common.synchronization [req-7cb8ba56-d7b2-4e4a-b895-99e5733f0672 req-78be0b08-064c-42a1-846c-e0bb01a071b7 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 739.271484] env[65107]: INFO networking_nsxv3.common.synchronization [req-7cb8ba56-d7b2-4e4a-b895-99e5733f0672 req-78be0b08-064c-42a1-846c-e0bb01a071b7 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_members [ 739.272330] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 739.272557] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_members [ 739.272976] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.273153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.273273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.273597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.273790] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.273944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.274038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.274275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.274400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.274548] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.276212] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d687430-4d43-4b83-afbb-82767bf9c7d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.276391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.276489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.276781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.276989] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.277157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.277249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.277494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.277833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.277833] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.365268] env[65107]: INFO networking_nsxv3.common.synchronization [req-7cb8ba56-d7b2-4e4a-b895-99e5733f0672 req-78be0b08-064c-42a1-846c-e0bb01a071b7 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_rules [ 739.365619] env[65107]: INFO networking_nsxv3.common.synchronization [req-7cb8ba56-d7b2-4e4a-b895-99e5733f0672 req-78be0b08-064c-42a1-846c-e0bb01a071b7 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_members [ 739.365619] env[65107]: INFO networking_nsxv3.common.synchronization [req-7cb8ba56-d7b2-4e4a-b895-99e5733f0672 req-78be0b08-064c-42a1-846c-e0bb01a071b7 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_rules [ 739.365756] env[65107]: INFO networking_nsxv3.common.synchronization [req-7cb8ba56-d7b2-4e4a-b895-99e5733f0672 req-78be0b08-064c-42a1-846c-e0bb01a071b7 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 739.365913] env[65107]: INFO networking_nsxv3.common.synchronization [req-7cb8ba56-d7b2-4e4a-b895-99e5733f0672 req-78be0b08-064c-42a1-846c-e0bb01a071b7 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with Priority: HIGHEST for action port [ 739.367228] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_rules [ 739.367521] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_rules [ 739.367770] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with Priority: HIGHEST for action port [ 739.367877] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_members [ 739.368159] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 739.368621] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d687430-4d43-4b83-afbb-82767bf9c7d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.368772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.369017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.369621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.369751] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.371293] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.371537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.371607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.371945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.372143] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.373934] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.374498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.374498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.374663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.374663] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.375834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d687430-4d43-4b83-afbb-82767bf9c7d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.375958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.376132] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.376532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.497645] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.513366] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.513585] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.513703] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.513987] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.514154] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.514303] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port b09350fa-f4ff-42b3-9406-b9f4595ecdea not found, creating... [ 739.514606] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.514757] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.514865] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.515094] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.515222] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.515494] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.515639] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.515746] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.515939] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.516231] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.516394] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea is going to be created. [ 739.538019] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.538291] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.538449] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.538761] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.539036] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.539303] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.622331] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.622515] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.622565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.622764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.622854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.622948] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 739.684838] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.685075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.685075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.685412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.685567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.704459] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 739.780058] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.782268] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.878488] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with status ACTIVE [ 739.878753] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.878886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.878931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.879181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.879273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.879485] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.879587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.879650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.879800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.879877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.880082] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.880178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.880238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.880374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.880448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.880529] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 is going to be updated. [ 739.882020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.882020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.882020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d687430-4d43-4b83-afbb-82767bf9c7d1 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.882154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.903161] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.903363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.903410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.903658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.903854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.904072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.000263] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.000263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.000263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.000263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.001386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.001455] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 740.074297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.074557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.074557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.074706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.074848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.085277] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 740.281940] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.285035] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.327226] env[65107]: INFO networking_nsxv3.common.synchronization [req-747e4d33-3c3a-4d83-afce-e255954b5bd3 req-685749d0-810a-48ce-bbd8-9f5ce745dcc3 service nova] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 740.327226] env[65107]: INFO networking_nsxv3.common.synchronization [req-747e4d33-3c3a-4d83-afce-e255954b5bd3 req-685749d0-810a-48ce-bbd8-9f5ce745dcc3 service nova] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 740.327226] env[65107]: INFO networking_nsxv3.common.synchronization [req-747e4d33-3c3a-4d83-afce-e255954b5bd3 req-685749d0-810a-48ce-bbd8-9f5ce745dcc3 service nova] Enqueued Resource ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea with Priority: HIGHEST for action port [ 740.327226] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 740.327226] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 740.327226] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea with Priority: HIGHEST for action port [ 740.327226] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.327226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.327226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.327226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.328667] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.336278] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.336278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.336278] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09350fa-f4ff-42b3-9406-b9f4595ecdea taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.336278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.336278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.336278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.336278] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09350fa-f4ff-42b3-9406-b9f4595ecdea',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.404172] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a469b2f-9178-42b0-be36-f1370374e744 in Status: SUCCESS [ 740.404172] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a469b2f-9178-42b0-be36-f1370374e744 deletion is rescheduled due to dependency. [ 740.404172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.404522] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 in Status: SUCCESS [ 740.404664] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 deletion is rescheduled due to dependency. [ 740.404712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be updated. [ 740.788023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 is going to be created. [ 740.823038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.823038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.823038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.823038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.823038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.831170] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.831170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.831170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.831170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.831170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.835537] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 in Status: UNINITIALIZED for 2s [ 740.838491] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 740.838879] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.839040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.841457] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09350fa-f4ff-42b3-9406-b9f4595ecdea with status ACTIVE [ 740.841740] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.841915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.842031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.842651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.842651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.842761] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.842852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.842939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.843151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.843266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.843466] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.843974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.843974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.843974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.843974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.843974] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea is going to be updated. [ 740.869310] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 740.869765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.869765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.871351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.871351] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.871351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.871351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.871351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.871351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.871351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.871351] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.872569] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.872794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.872794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.874925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.874925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.874925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.900027] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f3b6da59-80d6-4d6a-858a-9515f08574de None None] Enqueued Resource ID: 8ee74859-be93-4d59-a95b-4a5af8eb350f with Priority: HIGHEST for action port [ 740.900027] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee74859-be93-4d59-a95b-4a5af8eb350f with Priority: HIGHEST for action port [ 740.900618] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ee74859-be93-4d59-a95b-4a5af8eb350f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.900618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ee74859-be93-4d59-a95b-4a5af8eb350f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.900618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ee74859-be93-4d59-a95b-4a5af8eb350f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.900618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ee74859-be93-4d59-a95b-4a5af8eb350f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.900618] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ee74859-be93-4d59-a95b-4a5af8eb350f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.942691] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: SUCCESS [ 740.942914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.943096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.943455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.943503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.943614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.943679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.943824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.943902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.943985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.944087] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.015707] env[65107]: INFO networking_nsxv3.common.synchronization [req-944411e2-78f2-4da3-973b-2d3f52f4264e req-b53a66b7-b547-4edb-92dd-b3777a073fac tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 741.016335] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 741.016646] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.016770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.016834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.017171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.017330] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.017436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.017476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.017634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.017716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.017814] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.374691] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.374939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.374939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.375202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.375414] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.375519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.375639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.375696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.376175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.376175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.376175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.376175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.376175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.376504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.376504] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.376776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.376776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.376776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.376958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.376958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.377128] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.405483] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ee74859-be93-4d59-a95b-4a5af8eb350f [ 741.405790] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.405790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.405904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.406225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.406356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.406476] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ee74859-be93-4d59-a95b-4a5af8eb350f already deleted. [ 741.406571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ee74859-be93-4d59-a95b-4a5af8eb350f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.447494] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.521968] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.521968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.521968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.522213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.522213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.522364] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.522489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.522548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.523030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.523127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.523243] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 already deleted. [ 741.523334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.718681] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 741.718681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.718681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.718681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.718926] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.719134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.719245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.719607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.719861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.720065] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.787782] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.787974] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.788118] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.788464] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.788725] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.788884] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.788989] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.789310] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.789527] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.789767] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.789883] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.789989] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.790105] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.790214] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.790313] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.790443] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.810475] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.810682] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.810759] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.810936] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.811266] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-bf90d995-98e0-4881-a4fd-df8215566ca8 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.811438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.811552] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.811916] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.812063] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf90d995-98e0-4881-a4fd-df8215566ca8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.882962] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6801a112-5684-487c-b713-b3fc340c09d5: rpc.has_security_group_logging(os_id): False [ 741.902820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.903109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.903220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.903577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.903693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.903932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.904122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.904191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.904365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.904454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.904669] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.904813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.904872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.905079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.905165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.905370] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.905468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.905528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.905664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.905737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.905822] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be updated. [ 741.951072] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72f456f5-8ebf-4a3f-9abe-b5b8150be76b: rpc.has_security_group_logging(os_id): False [ 741.976522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.976696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.976733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.976915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.977012] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.977272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.977530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.977644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.977891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.977973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.978077] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b is going to be created. [ 741.980067] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.980214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.980275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.980416] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.980620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.994140] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 2s [ 742.048476] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.048640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.048696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.048902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.049102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.069827] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: IN_PROGRESS for 2s [ 742.098984] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 742.099224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.099461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.099678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.099874] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.099991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.100069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.100217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.100298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.100412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.100600] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.100698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.100758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.100895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.102104] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.102253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.102324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.102465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.102627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.102718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.102811] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.224809] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.316015] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.316015] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.316015] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.322403] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.322403] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.322403] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port bf90d995-98e0-4881-a4fd-df8215566ca8 not found, creating... [ 742.322403] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.322403] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.322403] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.322403] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.322403] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.323089] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.323933] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.324209] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.324539] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.325672] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.325672] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: bf90d995-98e0-4881-a4fd-df8215566ca8 is going to be created. [ 742.352026] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.352026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.352026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.352026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.352463] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.353033] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.605381] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c33a4c9-c386-4629-b92a-71c04d7941cd: rpc.has_security_group_logging(os_id): False [ 742.628687] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.628889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.629091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.629271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.629426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.629656] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.629758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.629825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.630126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.630208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.630386] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.630502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.630567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.630712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.630820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.631425] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.631580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.631580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.631750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.631849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.631998] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 742.712034] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.712034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.712034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.712034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.712034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.731055] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 742.731055] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.850494] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 in Status: SUCCESS [ 742.850798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.851026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.851344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.852496] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.852496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.852496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.852496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.852496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.852496] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.853936] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 742.854169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.854331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.854557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.854702] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.854808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.854867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.855018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.855121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.855214] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.003826] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1f011589-2050-4315-8c74-8e26f892c2ab None None] Enqueued Resource ID: 2f42a472-642c-46bf-9e41-758bd09daf01 with Priority: HIGHEST for action port [ 743.003826] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f42a472-642c-46bf-9e41-758bd09daf01 with Priority: HIGHEST for action port [ 743.004197] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f42a472-642c-46bf-9e41-758bd09daf01 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.004971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f42a472-642c-46bf-9e41-758bd09daf01" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.005174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f42a472-642c-46bf-9e41-758bd09daf01" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.008305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f42a472-642c-46bf-9e41-758bd09daf01" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.008305] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f42a472-642c-46bf-9e41-758bd09daf01',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.074389] env[65107]: INFO networking_nsxv3.common.synchronization [req-944411e2-78f2-4da3-973b-2d3f52f4264e req-37d1add5-e8fd-4e38-b40f-650f0d70862b service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 743.074389] env[65107]: INFO networking_nsxv3.common.synchronization [req-944411e2-78f2-4da3-973b-2d3f52f4264e req-37d1add5-e8fd-4e38-b40f-650f0d70862b service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 743.074389] env[65107]: INFO networking_nsxv3.common.synchronization [req-944411e2-78f2-4da3-973b-2d3f52f4264e req-37d1add5-e8fd-4e38-b40f-650f0d70862b service nova] Enqueued Resource ID: bf90d995-98e0-4881-a4fd-df8215566ca8 with Priority: HIGHEST for action port [ 743.075257] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 743.075850] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 743.076205] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf90d995-98e0-4881-a4fd-df8215566ca8 with Priority: HIGHEST for action port [ 743.077141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.077387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.077564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.078895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.078895] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.079627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.079749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.079835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.082489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.082699] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.082829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.082907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.083079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.083193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.083294] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.084431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf90d995-98e0-4881-a4fd-df8215566ca8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.084732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.084732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.084834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.084871] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf90d995-98e0-4881-a4fd-df8215566ca8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.233758] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.233931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.234010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.234248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.234371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.234475] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 743.267324] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.267446] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.267517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.267725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.267874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.277446] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 743.357539] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.358620] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.512299] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f42a472-642c-46bf-9e41-758bd09daf01 [ 743.512299] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.512492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.512551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.513486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.513486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.513486] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f42a472-642c-46bf-9e41-758bd09daf01 already deleted. [ 743.513486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f42a472-642c-46bf-9e41-758bd09daf01" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.587165] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.587260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.588971] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf90d995-98e0-4881-a4fd-df8215566ca8 with status ACTIVE [ 743.588971] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.588971] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.588971] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.588971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.589638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.589638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.589638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.589638] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf90d995-98e0-4881-a4fd-df8215566ca8 is going to be updated. [ 743.592188] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.621412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.621735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.621735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.621903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.622371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.622591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf90d995-98e0-4881-a4fd-df8215566ca8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.860561] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.863231] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.876152] env[65107]: INFO networking_nsxv3.common.synchronization [req-6398a792-db75-4138-a575-cda027783639 req-90cbc681-c17c-4c3f-9662-da933338b769 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_members [ 743.876327] env[65107]: INFO networking_nsxv3.common.synchronization [req-6398a792-db75-4138-a575-cda027783639 req-90cbc681-c17c-4c3f-9662-da933338b769 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 743.877340] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 with Priority: HIGHEST for action security_group_members [ 743.878196] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 743.878771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d687430-4d43-4b83-afbb-82767bf9c7d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.878771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.878771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.878939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.934287] env[65107]: INFO networking_nsxv3.common.synchronization [req-6398a792-db75-4138-a575-cda027783639 req-90cbc681-c17c-4c3f-9662-da933338b769 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_rules [ 743.934524] env[65107]: INFO networking_nsxv3.common.synchronization [req-6398a792-db75-4138-a575-cda027783639 req-90cbc681-c17c-4c3f-9662-da933338b769 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 743.934630] env[65107]: INFO networking_nsxv3.common.synchronization [req-6398a792-db75-4138-a575-cda027783639 req-90cbc681-c17c-4c3f-9662-da933338b769 tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with Priority: HIGHEST for action port [ 743.935996] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_rules [ 743.936150] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 743.936251] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with Priority: HIGHEST for action port [ 743.937048] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.937048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.937203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.937349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.937598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.937697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.937763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.938386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.938907] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.012207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 744.012446] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.083937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: SUCCESS [ 744.084172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.099457] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.367191] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.367392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.367437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.370080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.370080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.370080] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 is going to be updated. [ 744.370080] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.370080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.370080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.370080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.370080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.370080] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be updated. [ 744.424405] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.424593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.424709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.424960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.425212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.428072] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.428072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.428072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.431732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.431732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.444532] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 in Status: IN_PROGRESS for 2s [ 744.445625] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 with status ACTIVE [ 744.446038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.446279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.446448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.446811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.447168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.447502] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.447718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.447867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.450022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.450022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.450022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.450022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.450022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.450022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.450022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.450022] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727 is going to be updated. [ 744.452434] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 744.480180] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.480624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.483024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.483024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.483024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.483024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a0d5c2-16a8-4b93-890a-0b4f5cb4c727" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.601419] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.601601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.601647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.601882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.601971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.602084] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be created. [ 744.641839] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.642306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.642306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.642453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.645719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.657218] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: UNINITIALIZED for 2s [ 744.749366] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 744.749366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.749366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.749366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.749366] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.161986] env[65107]: INFO networking_nsxv3.common.synchronization [req-197ca690-16ec-4fdb-ad3a-bd9e6f718d7b req-ac93ea3b-2b42-4875-9d31-47c2cf3832e9 tempest-VolumesAssistedSnapshotsTest-73147858 tempest-VolumesAssistedSnapshotsTest-73147858-project-member] Enqueued Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_members [ 745.162636] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_members [ 745.163167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-560f9d77-f914-4f8b-bc22-1688e970b817 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.163330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.163439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.163744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.163910] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.164037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.164101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.165341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.165341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.165341] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.251864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.252036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.252121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.252332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.253107] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.253107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.253107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.253352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.253352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.253450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.253540] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.299782] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 745.300189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.300275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.300506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.300850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.300850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.301026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.301475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.301475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.301475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.301691] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.668632] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.669348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.669348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.669778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.670424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.670424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.670424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.670937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.670937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.670937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.670937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 560f9d77-f914-4f8b-bc22-1688e970b817 already deleted. [ 745.672315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.704791] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.704990] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-944" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.705214] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-944" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.705717] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-944" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.705832] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.705961] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.707169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.707169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.707169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.707169] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.707169] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.708858] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.708858] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.708858] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.708858] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.708858] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.730028] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.730270] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.730417] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.730746] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-944" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.731131] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.731355] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.731476] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.731808] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.731938] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ba8e0f-ca8b-431d-8789-7ad756827b3f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.756920] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.757803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.757803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.757803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.757803] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.758025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.758151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.759683] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.759683] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.759683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.760186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.760186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.760186] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.809023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.809023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.809023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.809023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.809023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.810026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.810026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.810026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.810026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.810026] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.235814] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.236083] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.236830] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.236830] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.236969] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.237263] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port b5ba8e0f-ca8b-431d-8789-7ad756827b3f not found, creating... [ 746.237658] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.237815] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.237925] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.238256] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.238479] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.238843] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.239029] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.239203] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.239546] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.239701] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.239864] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: b5ba8e0f-ca8b-431d-8789-7ad756827b3f is going to be created. [ 746.260830] env[65107]: INFO networking_nsxv3.common.synchronization [req-1753e764-0651-4097-847c-b24a72bf06a4 req-2b879a44-57a5-4f3c-9e0a-e573890b9387 tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 746.261464] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 746.261791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.261913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.262028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.262200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.262357] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.262454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.262518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.262665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.262752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.262848] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.263787] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c33a4c9-c386-4629-b92a-71c04d7941cd: rpc.has_security_group_logging(os_id): False [ 746.273425] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.273640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.274042] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.274176] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.274394] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.274615] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.287576] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.287995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.287995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.288247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.288247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.289070] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.289070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.289070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.289279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.289279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.289828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.289949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.290113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.290265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.290401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.291440] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.291440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.291440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.291617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.291617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.291675] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 746.315068] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8: rpc.has_security_group_logging(os_id): False [ 746.371040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.371259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.371386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.371775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.371933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.372294] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.372507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.372608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.372836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.372962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.373745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.373745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.374033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.374115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.374326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.374568] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.374739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.374841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.375292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.375292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.375457] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 746.530631] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 746.530631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.530631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.530631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.530631] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.530631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.530631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.531319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.531885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.532122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.532316] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.537518] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 in Status: SUCCESS [ 746.539571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.539571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.539571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.539571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.539571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.539571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.539571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.539571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.539917] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.541022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.546711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.554028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.554028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.554028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.554028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.554028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.554028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.554028] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.554692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.554934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.555193] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.555461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.555604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.555749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.555886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.556073] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.590911] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.591108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.591170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.591392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.591792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.598093] env[65107]: INFO networking_nsxv3.common.synchronization [req-7f3d88e5-8086-44d0-a363-7aae37904aac req-bfbeb61c-4384-48e6-ada5-2a0e2249a585 tempest-InstanceActionsTestJSON-620540974 tempest-InstanceActionsTestJSON-620540974-project-member] Enqueued Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_members [ 746.598832] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGHEST for action security_group_members [ 746.599199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.599329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.599400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.599689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.599869] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.599976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.600133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.600253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.600333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.600540] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.615860] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 746.670199] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 746.670199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.670199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.670199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.670199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.670821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.670821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.670821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.670941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.671437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.671601] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.692975] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.693412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.693545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.693757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.694068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.739960] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 746.766373] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.767588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.767588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.767588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.767588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.767588] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.767988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.767988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.768134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.768261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.768502] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 746.814269] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.814269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.814269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.814269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.814269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.832676] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 747.007022] env[65107]: INFO networking_nsxv3.common.synchronization [req-197ca690-16ec-4fdb-ad3a-bd9e6f718d7b req-4eb742dd-cd81-41c4-9002-df8a7b6806da service nova] Enqueued Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_rules [ 747.007022] env[65107]: INFO networking_nsxv3.common.synchronization [req-197ca690-16ec-4fdb-ad3a-bd9e6f718d7b req-4eb742dd-cd81-41c4-9002-df8a7b6806da service nova] Enqueued Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_members [ 747.007022] env[65107]: INFO networking_nsxv3.common.synchronization [req-197ca690-16ec-4fdb-ad3a-bd9e6f718d7b req-4eb742dd-cd81-41c4-9002-df8a7b6806da service nova] Enqueued Resource ID: b5ba8e0f-ca8b-431d-8789-7ad756827b3f with Priority: HIGHEST for action port [ 747.007022] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_rules [ 747.007022] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_members [ 747.007022] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ba8e0f-ca8b-431d-8789-7ad756827b3f with Priority: HIGHEST for action port [ 747.007022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-560f9d77-f914-4f8b-bc22-1688e970b817 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.007022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.007022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.007022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.007022] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.008096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-560f9d77-f914-4f8b-bc22-1688e970b817 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.008441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.008441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.008730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.008936] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.009158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.009502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.009697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.009796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.009902] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.010906] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.012164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.012233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.012413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.012488] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ba8e0f-ca8b-431d-8789-7ad756827b3f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.053994] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.054082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.054265] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.059342] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d687430-4d43-4b83-afbb-82767bf9c7d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.059810] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.059890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.059957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.060210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.060308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.060519] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.060970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.060970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.060970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.060970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.060970] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 is going to be deleted. [ 747.106040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.106040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.106040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.106040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 is going to be updated. [ 747.148979] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.148979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.148979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.148979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.148979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.148979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.155056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.155245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.155321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.155675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.156548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.172423] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 in Status: IN_PROGRESS for 2s [ 747.174315] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.174315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.174315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.174567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.174636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.174745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.174829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.174986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.175084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.175191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.175341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.175459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.175505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.175648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.175809] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.175898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.175960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.176160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.176210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.176374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.176374] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.514955] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.516110] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-560f9d77-f914-4f8b-bc22-1688e970b817 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.516274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.516417] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5ba8e0f-ca8b-431d-8789-7ad756827b3f with status ACTIVE [ 747.516720] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.516720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.516877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.516994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.517093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.517394] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.517394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.517519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.517657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.517726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.517938] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.519105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.519105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.519105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.519105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.519105] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5ba8e0f-ca8b-431d-8789-7ad756827b3f is going to be updated. [ 747.548651] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.549052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.549249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.549747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.550053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.550335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ba8e0f-ca8b-431d-8789-7ad756827b3f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.556854] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.563302] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d687430-4d43-4b83-afbb-82767bf9c7d1: rpc.has_security_group_logging(os_id): False [ 747.591173] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.591173] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.591173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.591553] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 is going to be created. [ 747.617362] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1d687430-4d43-4b83-afbb-82767bf9c7d1], does not exist path=[/infra/domains/default/groups/1d687430-4d43-4b83-afbb-82767bf9c7d1]."\n}' [ 747.617362] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1d687430-4d43-4b83-afbb-82767bf9c7d1 [ 747.617362] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 747.681144] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6970c294-30ba-4814-9be8-ff7a47ecd5e8: rpc.has_security_group_logging(os_id): False [ 747.682301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.682652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.682836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.683210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.684886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.686684] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.686684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.686684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.686684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.686684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.686684] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.686684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.686684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.687180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.687676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.687789] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d687430-4d43-4b83-afbb-82767bf9c7d1 is going to be created. [ 747.731757] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.732017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.732088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.732296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.732379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.732646] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.732792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.732833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.733020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.733135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.733358] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.733461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.733526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.733741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.733741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.734174] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.734174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.734174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.734330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.734468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.734607] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be created. [ 747.737278] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1d687430-4d43-4b83-afbb-82767bf9c7d1], does not exist path=[/infra/domains/default/groups/1d687430-4d43-4b83-afbb-82767bf9c7d1]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1d687430-4d43-4b83-afbb-82767bf9c7d1 [ 747.737278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d687430-4d43-4b83-afbb-82767bf9c7d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.738594] env[65107]: Traceback (most recent call last): [ 747.738594] env[65107]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 747.738594] env[65107]: return func(*args, **kwargs) [ 747.738594] env[65107]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 747.738594] env[65107]: res.raise_for_status() [ 747.738594] env[65107]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 747.738594] env[65107]: raise HTTPError(http_error_msg, response=self) [ 747.738594] env[65107]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1d687430-4d43-4b83-afbb-82767bf9c7d1 [ 747.738594] env[65107]: During handling of the above exception, another exception occurred: [ 747.738594] env[65107]: Traceback (most recent call last): [ 747.738594] env[65107]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 747.738594] env[65107]: listener.cb(fileno) [ 747.738594] env[65107]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 747.738594] env[65107]: result = function(*args, **kwargs) [ 747.738594] env[65107]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 747.738594] env[65107]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 747.738594] env[65107]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 747.738594] env[65107]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 747.738594] env[65107]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 747.738594] env[65107]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 747.738594] env[65107]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 747.738594] env[65107]: res.raise_for_status() [ 747.738594] env[65107]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 747.738594] env[65107]: raise HTTPError(http_error_msg, response=self) [ 747.738594] env[65107]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1d687430-4d43-4b83-afbb-82767bf9c7d1 [ 747.738594] env[65107]: Removing descriptor: 5 [ 747.841093] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.841806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.841806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.841806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.841988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.856348] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 748.020018] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.059289] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.059588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.061095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.061339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.061437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.061583] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be updated. [ 748.095832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.095978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.095978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.096185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.096298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.108590] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 748.524177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.524411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.524411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.524595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.524704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.524828] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 560f9d77-f914-4f8b-bc22-1688e970b817 is going to be created. [ 748.558431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.558651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.562028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.562880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.562880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.580614] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 560f9d77-f914-4f8b-bc22-1688e970b817 in Status: UNINITIALIZED for 2s [ 748.644498] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 748.644919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.692574] env[65107]: INFO networking_nsxv3.common.synchronization [req-a25f0780-381c-4b6f-8cb7-686f31fbbddb req-2dac83bd-dc4d-412d-a7f5-7fb07fd6fc66 tempest-ListServersNegativeTestJSON-227968552 tempest-ListServersNegativeTestJSON-227968552-project-member] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 748.693484] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 748.693602] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.693737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.693828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.694135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.694315] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.694423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.694486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.694644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.694731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.694831] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.777934] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 748.778149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.846755] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 748.846940] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 deletion is rescheduled due to dependency. [ 748.847084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.186330] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 in Status: SUCCESS [ 749.186507] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 deletion is rescheduled due to dependency. [ 749.186638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.197273] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.524174] env[65107]: INFO networking_nsxv3.common.synchronization [req-b51bb98d-b5cf-4cbe-af7d-78736f29d6ab req-cfa583d4-255d-4dc9-9518-590c748d4149 tempest-ServersWithSpecificFlavorTestJSON-1770061733 tempest-ServersWithSpecificFlavorTestJSON-1770061733-project-member] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 749.524801] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 749.526545] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.526675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.526851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.526965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.527706] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.527706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.529664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.529664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.529664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.529664] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.700963] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.872284] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 749.872567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.946294] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.946430] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.946531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.946763] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.947017] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.950342] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.950468] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.950734] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.950878] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.951203] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.951203] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.951303] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.951473] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.951544] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.951594] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.951706] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.972794] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.972794] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.974293] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.974293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-303" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.974293] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-4a5a3518-96b8-480e-9ad4-722122d651f4 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.974293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.974293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.974762] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.974762] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5a3518-96b8-480e-9ad4-722122d651f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.032862] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.033183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.033293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.033634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.063176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.063176] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.063176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.063176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.063531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.063531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.063531] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be updated. [ 750.119658] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 750.120173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.120173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.120351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.120594] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.121103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.121103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.121103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.121103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.121249] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.129096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.129282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.129347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.129639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.129819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.142455] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: IN_PROGRESS for 2s [ 750.203435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.203435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.203435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.203435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.203435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.203685] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 750.272776] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.272776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.272776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.272776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.272776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.284967] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 750.479071] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.479402] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.479633] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.479993] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.480336] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.480576] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 4a5a3518-96b8-480e-9ad4-722122d651f4 not found, creating... [ 750.480964] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.481271] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.481445] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.481767] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.482053] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.482454] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.482729] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.482880] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.483215] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.483752] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.483941] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 4a5a3518-96b8-480e-9ad4-722122d651f4 is going to be created. [ 750.507229] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.507541] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.507676] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.508071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.508397] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.508708] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.604425] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 560f9d77-f914-4f8b-bc22-1688e970b817 in Status: SUCCESS [ 750.604605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.604786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.605014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.605315] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.605443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.605495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.605814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.605814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.605934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.605965] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.624416] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.108735] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.127258] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.207268] env[65107]: INFO networking_nsxv3.common.synchronization [req-b51bb98d-b5cf-4cbe-af7d-78736f29d6ab req-f33757ee-eefe-4ac2-ab35-1f6a4db3939e service nova] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 751.207268] env[65107]: INFO networking_nsxv3.common.synchronization [req-b51bb98d-b5cf-4cbe-af7d-78736f29d6ab req-f33757ee-eefe-4ac2-ab35-1f6a4db3939e service nova] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 751.207268] env[65107]: INFO networking_nsxv3.common.synchronization [req-b51bb98d-b5cf-4cbe-af7d-78736f29d6ab req-f33757ee-eefe-4ac2-ab35-1f6a4db3939e service nova] Enqueued Resource ID: 4a5a3518-96b8-480e-9ad4-722122d651f4 with Priority: HIGHEST for action port [ 751.207268] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_rules [ 751.207268] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 751.207268] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5a3518-96b8-480e-9ad4-722122d651f4 with Priority: HIGHEST for action port [ 751.208035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.208304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.208465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.208846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.209014] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.210417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.210674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.211034] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a5a3518-96b8-480e-9ad4-722122d651f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.211276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.212301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.212587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.212777] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5a3518-96b8-480e-9ad4-722122d651f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.611120] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 560f9d77-f914-4f8b-bc22-1688e970b817: rpc.has_security_group_logging(os_id): False [ 751.628872] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.628872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.628872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.629055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.629085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.629336] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.629522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.629522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.629741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.629796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.629858] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 560f9d77-f914-4f8b-bc22-1688e970b817 is going to be created. [ 751.631351] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.631484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.631551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.631708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.631786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.631869] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be updated. [ 751.674017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.674228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.674360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.674538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.674688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.684409] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 751.714722] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.714875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.714991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.715336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.715646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.717747] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.717903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.718209] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a5a3518-96b8-480e-9ad4-722122d651f4 with status ACTIVE [ 751.718486] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.718744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.718804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.719297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.719350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.719772] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.720561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.720561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.720561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.720561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.720732] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.726032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.726032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.726032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.726032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.726032] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a5a3518-96b8-480e-9ad4-722122d651f4 is going to be updated. [ 751.736142] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 560f9d77-f914-4f8b-bc22-1688e970b817 in Status: IN_PROGRESS for 2s [ 751.753806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.754696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.754696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.754696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.754696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.755057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a5a3518-96b8-480e-9ad4-722122d651f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.155061] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 752.155305] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 deletion is rescheduled due to dependency. [ 752.155348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.155557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.155741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.155923] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.156045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.156111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.156267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.156343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.156435] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.300290] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 752.300535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.661791] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.164816] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.668253] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.668410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.668486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.668760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.668934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.669056] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be updated. [ 753.698850] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 753.699088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.699263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.699499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.699812] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.699933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.700019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.700233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.700386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.700386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.700580] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.700771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.700771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.700915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.701912] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.702012] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.702050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.702265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.702631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.702631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.702631] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.704722] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.704836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.704901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.705061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.705192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.714508] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: IN_PROGRESS for 2s [ 753.748695] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 560f9d77-f914-4f8b-bc22-1688e970b817 in Status: SUCCESS [ 753.748695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.168749] env[65107]: INFO networking_nsxv3.common.synchronization [req-d23f301b-29d5-422c-aeec-c2d490c9a45f req-36fe96fd-d9eb-4eb8-986e-d220108b7f30 tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 754.169370] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 754.169721] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.169843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.169906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.170444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.170951] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.170951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.170951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.171171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.171212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.171349] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.204273] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2304da05-6fdb-4605-ba99-e497cf0fe331: rpc.has_security_group_logging(os_id): False [ 754.227462] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.227462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.227462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.227462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.252153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.252153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.252153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.252153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.252153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.252153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.252591] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.252591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.252591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.252747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.252747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.253019] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.253019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.253214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.253214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.253334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.253396] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be updated. [ 754.377109] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.377837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.377969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.378230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.378457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.417945] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 754.660549] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.661610] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.661610] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.661610] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.662260] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.662665] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.662962] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.663747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.663747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.663747] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.664060] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.664060] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.664060] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.664354] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.664636] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.664818] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.675798] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.675963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.676064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.676341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.676595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.676935] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.677079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.677158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.677413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.677759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.677759] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f already deleted. [ 754.677759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.701029] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.701029] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.701029] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.701029] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.701029] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-115cf32b-90e7-4c66-a030-6d22474bd307 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.701537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.701537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.701537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.701686] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('115cf32b-90e7-4c66-a030-6d22474bd307',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.748485] env[65107]: INFO networking_nsxv3.common.synchronization [None req-03382169-003c-44d1-9853-4dd364846e44 None None] Enqueued Resource ID: 7ec7bb33-fc76-4f09-8cef-89df4a3446a9 with Priority: HIGHEST for action port [ 754.749236] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec7bb33-fc76-4f09-8cef-89df4a3446a9 with Priority: HIGHEST for action port [ 754.749683] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ec7bb33-fc76-4f09-8cef-89df4a3446a9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.749870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ec7bb33-fc76-4f09-8cef-89df4a3446a9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.749962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ec7bb33-fc76-4f09-8cef-89df4a3446a9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.750334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ec7bb33-fc76-4f09-8cef-89df4a3446a9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.750468] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ec7bb33-fc76-4f09-8cef-89df4a3446a9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.206588] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.206588] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.207537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.207970] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.208839] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.208915] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 115cf32b-90e7-4c66-a030-6d22474bd307 not found, creating... [ 755.209360] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.209554] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.209781] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.210134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.210312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.210717] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.210939] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.213348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.213348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.213348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.213348] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 115cf32b-90e7-4c66-a030-6d22474bd307 is going to be created. [ 755.236705] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.237083] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.237314] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.237659] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.239950] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.240299] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.253083] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ec7bb33-fc76-4f09-8cef-89df4a3446a9 [ 755.253660] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.253995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.254108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.254402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.254513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.255219] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ec7bb33-fc76-4f09-8cef-89df4a3446a9 already deleted. [ 755.255219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ec7bb33-fc76-4f09-8cef-89df4a3446a9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.728035] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 755.728035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.728035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.728035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.728035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.728035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.728035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.728519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.728519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.728822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.728977] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.049379] env[65107]: INFO networking_nsxv3.common.synchronization [req-d23f301b-29d5-422c-aeec-c2d490c9a45f req-b9780892-ed18-42fb-8853-c3bea3bf5736 service nova] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_rules [ 756.049594] env[65107]: INFO networking_nsxv3.common.synchronization [req-d23f301b-29d5-422c-aeec-c2d490c9a45f req-b9780892-ed18-42fb-8853-c3bea3bf5736 service nova] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 756.049854] env[65107]: INFO networking_nsxv3.common.synchronization [req-d23f301b-29d5-422c-aeec-c2d490c9a45f req-b9780892-ed18-42fb-8853-c3bea3bf5736 service nova] Enqueued Resource ID: 115cf32b-90e7-4c66-a030-6d22474bd307 with Priority: HIGHEST for action port [ 756.050426] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_rules [ 756.050787] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 756.050787] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115cf32b-90e7-4c66-a030-6d22474bd307 with Priority: HIGHEST for action port [ 756.050932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.052121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.052121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.052121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.052121] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.054161] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.054161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.054161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.054161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.054396] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.054396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.054396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.054507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.054619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.054684] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.055892] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-115cf32b-90e7-4c66-a030-6d22474bd307 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.056032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.056700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.056922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.057021] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('115cf32b-90e7-4c66-a030-6d22474bd307',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.234502] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.435592] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 756.435838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.436028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.436252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.436346] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.554379] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.554583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.559931] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.560980] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 115cf32b-90e7-4c66-a030-6d22474bd307 with status ACTIVE [ 756.561195] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.561322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.561381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.561597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.561672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.563395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.563395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.563395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.563395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 115cf32b-90e7-4c66-a030-6d22474bd307 is going to be updated. [ 756.588025] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.588025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.588025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.588025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.588334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.588334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-115cf32b-90e7-4c66-a030-6d22474bd307" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.736931] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5a9e810-a93e-4373-b821-f175316f25f4: rpc.has_security_group_logging(os_id): False [ 756.755709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.755889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.755986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.756162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.756248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.756491] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.756589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.756652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.756814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.757073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.757073] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be updated. [ 756.837772] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.839146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.839299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.839625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.839780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.859209] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: IN_PROGRESS for 2s [ 756.939663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.939888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.939965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.941414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.941627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.941743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.941809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.942030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.942122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.942213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.942304] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.066497] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.173744] env[65107]: INFO networking_nsxv3.common.synchronization [req-586f9627-5e23-4140-8364-84c8626163ec req-22aec26c-92f4-48f2-8681-2e0de149e8c3 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 757.175316] env[65107]: INFO networking_nsxv3.common.synchronization [req-586f9627-5e23-4140-8364-84c8626163ec req-22aec26c-92f4-48f2-8681-2e0de149e8c3 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 757.175703] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 757.175964] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 757.176373] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.176609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.176786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.177427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.177489] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.177782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.177883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.178272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.178405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.178518] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.180987] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.180987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.180987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.181253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.181326] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.181448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.181512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.181763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.181886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.182056] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.237586] env[65107]: INFO networking_nsxv3.common.synchronization [req-586f9627-5e23-4140-8364-84c8626163ec req-22aec26c-92f4-48f2-8681-2e0de149e8c3 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_rules [ 757.237879] env[65107]: INFO networking_nsxv3.common.synchronization [req-586f9627-5e23-4140-8364-84c8626163ec req-22aec26c-92f4-48f2-8681-2e0de149e8c3 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [req-586f9627-5e23-4140-8364-84c8626163ec req-22aec26c-92f4-48f2-8681-2e0de149e8c3 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [req-586f9627-5e23-4140-8364-84c8626163ec req-22aec26c-92f4-48f2-8681-2e0de149e8c3 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [req-586f9627-5e23-4140-8364-84c8626163ec req-22aec26c-92f4-48f2-8681-2e0de149e8c3 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea with Priority: HIGHEST for action port [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_rules [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea with Priority: HIGHEST for action port [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 757.240855] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 757.240855] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.240855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.240855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.240855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.240855] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.242881] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.242881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.242881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.242881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.242881] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.245383] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09350fa-f4ff-42b3-9406-b9f4595ecdea taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.245471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.245556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.246040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.246152] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09350fa-f4ff-42b3-9406-b9f4595ecdea',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.247485] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.247598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.247793] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.248741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.447227] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.447448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.447555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.447839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.448036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.448155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.448220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.448374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.448461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.448550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.448735] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.448831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.449065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.449129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.449303] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.449431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.449506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.451317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.451409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.451504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.451595] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.524360] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7572161d-1671-4a44-bf9e-83be9d5369af None None] Enqueued Resource ID: 44168e6f-3ff3-4c9d-abee-6019b4ff41c1 with Priority: HIGHEST for action port [ 757.525066] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44168e6f-3ff3-4c9d-abee-6019b4ff41c1 with Priority: HIGHEST for action port [ 757.526637] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-44168e6f-3ff3-4c9d-abee-6019b4ff41c1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.527517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44168e6f-3ff3-4c9d-abee-6019b4ff41c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.527517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44168e6f-3ff3-4c9d-abee-6019b4ff41c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.527517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44168e6f-3ff3-4c9d-abee-6019b4ff41c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.527517] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44168e6f-3ff3-4c9d-abee-6019b4ff41c1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.568979] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.569179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.569258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.569475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.569562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.569728] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be created. [ 757.597878] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.598070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.599214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.599214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.599214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.612787] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: UNINITIALIZED for 2s [ 757.686270] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.686791] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.752301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.752301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.752301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.752301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.752301] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09350fa-f4ff-42b3-9406-b9f4595ecdea with status ACTIVE [ 757.752706] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.752800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.752914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.753233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.753421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.753687] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.753842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.753935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.754253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.754394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.754876] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.754876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.755121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.755873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.755992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.756157] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea is going to be updated. [ 757.786534] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.786954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.786954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.787066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.787820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.787820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.956809] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2304da05-6fdb-4605-ba99-e497cf0fe331: rpc.has_security_group_logging(os_id): False [ 757.980253] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.980487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.980606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.980859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.980947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.981173] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.981277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.981342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.981503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.981589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.981899] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.982015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.982079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.983196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.983196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.983567] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.983754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.983879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.984115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.984242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.984419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be updated. [ 758.030060] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44168e6f-3ff3-4c9d-abee-6019b4ff41c1 [ 758.030358] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.030499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.030580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.030806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.030896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.030988] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44168e6f-3ff3-4c9d-abee-6019b4ff41c1 already deleted. [ 758.031082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44168e6f-3ff3-4c9d-abee-6019b4ff41c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.092088] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.093281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.093281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.093281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.093281] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.116656] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 758.190165] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.192027] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.694741] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.695090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.695090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.695284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.695284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.695340] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be created. [ 758.697514] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.697514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.697514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.697514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.697905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.697905] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 758.738291] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.738654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.738654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.738654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.738904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.742215] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.742376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.742376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.742517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.742703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.752921] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 758.753482] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: UNINITIALIZED for 2s [ 758.876301] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 758.877139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.174636] env[65107]: INFO networking_nsxv3.common.synchronization [req-dc7dcf2c-bead-4d30-9447-66c4f1107770 req-e48401f8-5d35-4b7f-b4d8-781832d3b67b tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 759.175461] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 759.175745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.175889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.175991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.176213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.176757] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.177817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.177817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.178034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.178146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.178303] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.460233] env[65107]: INFO networking_nsxv3.common.synchronization [req-dc7dcf2c-bead-4d30-9447-66c4f1107770 req-ed60ee17-ca8b-493c-8014-67aad8d6e305 tempest-ServersTestMultiNic-409008722 tempest-ServersTestMultiNic-409008722-project-member] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 759.460862] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGHEST for action security_group_members [ 759.461304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.461444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.556146] env[65107]: INFO networking_nsxv3.common.synchronization [req-986bd4c9-574f-49a6-960a-fbc86b959f55 req-73fc06e3-a936-4660-bba8-b28c91534980 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_members [ 759.558117] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_members [ 759.558589] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.558775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.558892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.559341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.559596] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.559757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.559851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.560127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.560267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.560435] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.625817] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 759.625817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.626521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.626521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.626521] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.626521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.626892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.626892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.626892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.626892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.627100] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.680321] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.978862] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.979187] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.979187] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.979508] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.979816] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.979987] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.980575] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.980848] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.980999] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.981260] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.981373] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.981479] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.981583] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.981703] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.981807] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.981969] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.003482] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.003670] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.003931] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.004157] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.004510] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-5bfcf882-75ed-49ff-9137-8b41c1c7f839 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.004688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.005624] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.006117] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.006316] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bfcf882-75ed-49ff-9137-8b41c1c7f839',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.068008] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.068444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.068444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.068587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.068587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.068760] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.068878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.068934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.069078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.069165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.069270] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 already deleted. [ 760.069356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.130933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.131176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.131176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.131414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.131601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.131702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.131773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.131911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.132025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.132129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.132295] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.132421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.132501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.132600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.132752] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.132860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.132948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.133062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.133186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.133282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.133380] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.139275] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 760.139580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.184541] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.508900] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.509270] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.509480] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.509770] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.509948] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.510147] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 5bfcf882-75ed-49ff-9137-8b41c1c7f839 not found, creating... [ 760.510424] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.510580] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.510743] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.511022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.511206] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.511573] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.511744] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.511858] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.512076] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.512207] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.512469] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 5bfcf882-75ed-49ff-9137-8b41c1c7f839 is going to be created. [ 760.536711] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.537043] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.537215] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.537522] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.537843] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.538124] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.635870] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cc3c5b-5d64-430b-ba1a-61805cb1246f: rpc.has_security_group_logging(os_id): False [ 760.671903] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.672173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.672173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.672344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.672436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.672630] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.672727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.672796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.673302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.673302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.673302] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.673302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.673587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.673587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.673587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.673717] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.673787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.673853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.674044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.674196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.674196] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be created. [ 760.688346] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.688632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.688699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.688954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.689071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.689198] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 760.724626] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.724835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.724835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.725153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.725372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.740562] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 760.772441] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.772783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.772783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.773043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.773275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.775360] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 760.775593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.776418] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: SUCCESS [ 760.776587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.777143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.777368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.777579] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.777775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.777855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.778068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.778148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.778273] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.779214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.779393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.779601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.779740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.779809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.779956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.780053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.780148] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.809081] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 761.283574] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.286211] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.296670] env[65107]: INFO networking_nsxv3.common.synchronization [req-986bd4c9-574f-49a6-960a-fbc86b959f55 req-203baf1b-97b2-4eb0-9e2f-7476b3fbad57 service nova] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_rules [ 761.297250] env[65107]: INFO networking_nsxv3.common.synchronization [req-986bd4c9-574f-49a6-960a-fbc86b959f55 req-203baf1b-97b2-4eb0-9e2f-7476b3fbad57 service nova] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_members [ 761.297507] env[65107]: INFO networking_nsxv3.common.synchronization [req-986bd4c9-574f-49a6-960a-fbc86b959f55 req-203baf1b-97b2-4eb0-9e2f-7476b3fbad57 service nova] Enqueued Resource ID: 5bfcf882-75ed-49ff-9137-8b41c1c7f839 with Priority: HIGHEST for action port [ 761.298600] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_rules [ 761.298911] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_members [ 761.299873] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bfcf882-75ed-49ff-9137-8b41c1c7f839 with Priority: HIGHEST for action port [ 761.301640] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.301810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.302052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.302225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.302490] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.303626] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.303762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.303837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.304102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.304330] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.304445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.304490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.304690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.304791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.304910] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.308224] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bfcf882-75ed-49ff-9137-8b41c1c7f839 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.308358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.308409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.308599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.308681] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bfcf882-75ed-49ff-9137-8b41c1c7f839',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.789551] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.790615] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.811482] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.811611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.811904] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bfcf882-75ed-49ff-9137-8b41c1c7f839 with status ACTIVE [ 761.812367] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.812367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.812367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.812514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.812847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.813045] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.813205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.813277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.813448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.813606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.813732] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.813850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.813896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.814227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.814227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.814227] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bfcf882-75ed-49ff-9137-8b41c1c7f839 is going to be updated. [ 761.815789] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.844229] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.844361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.844450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.845039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.845039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.845039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bfcf882-75ed-49ff-9137-8b41c1c7f839" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.257144] env[65107]: INFO networking_nsxv3.common.synchronization [req-b56d6e54-9418-4518-8bc4-7b60cfa2a1c8 req-8a75bc58-54dc-4d7d-9570-08f4214f3ea9 tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 762.257144] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 762.257144] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.257144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.257144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.257144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.257144] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.257144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.259322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.259423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.259518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.260324] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.293787] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.293787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.293787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.293787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.294191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.294191] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be updated. [ 762.297694] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.297694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.297694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.297694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.297694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.297694] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 762.317910] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.334088] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.334261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.334337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.334615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.335071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.337791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.337791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.337791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.338338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.338531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.355145] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: IN_PROGRESS for 2s [ 762.358702] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 762.733994] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-100 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.738618] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.738912] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.739621] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.740183] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.740461] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.741561] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.742281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.742541] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.742880] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.743093] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.743295] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.743492] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.743925] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.744129] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.744357] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.757699] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 762.758184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.758477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.758800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.759102] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.759287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.759400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.759649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.759809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.759967] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.762970] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.772021] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.772343] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.772557] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.772801] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-100" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.773270] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-784b82ed-04e5-4478-93e7-b8845b67d98e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.773541] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.773760] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.774646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.774881] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('784b82ed-04e5-4478-93e7-b8845b67d98e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.822250] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 762.822514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.822938] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.823080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.823149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.823361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.823459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.823550] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 is going to be created. [ 762.848556] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.848708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.848789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.849501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.849501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.862034] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: UNINITIALIZED for 2s [ 763.262879] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.262879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.262879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.263163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.268442] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.280314] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.280314] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.280596] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.281886] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.282154] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.282620] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 784b82ed-04e5-4478-93e7-b8845b67d98e not found, creating... [ 763.282702] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.282931] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.283392] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.283926] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.284163] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.284672] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.286181] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.286320] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.286804] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.286804] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.286939] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 784b82ed-04e5-4478-93e7-b8845b67d98e is going to be created. [ 763.306516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.308049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.308049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.308049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.308049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.309601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.309601] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be updated. [ 763.317923] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.318273] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.318426] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.318735] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.318979] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.319273] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.375945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.376593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.376593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.376593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.376757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.390535] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: IN_PROGRESS for 2s [ 763.777063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.777306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.777555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.777630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.777731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.777844] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 763.814439] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.814587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.814648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.814871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.815087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.827925] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 764.006227] env[65107]: INFO networking_nsxv3.common.synchronization [req-b56d6e54-9418-4518-8bc4-7b60cfa2a1c8 req-17632a7d-aea1-4e21-bc4e-630a7974d537 service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 764.006407] env[65107]: INFO networking_nsxv3.common.synchronization [req-b56d6e54-9418-4518-8bc4-7b60cfa2a1c8 req-17632a7d-aea1-4e21-bc4e-630a7974d537 service nova] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 764.006536] env[65107]: INFO networking_nsxv3.common.synchronization [req-b56d6e54-9418-4518-8bc4-7b60cfa2a1c8 req-17632a7d-aea1-4e21-bc4e-630a7974d537 service nova] Enqueued Resource ID: 784b82ed-04e5-4478-93e7-b8845b67d98e with Priority: HIGHEST for action port [ 764.007914] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_rules [ 764.008088] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 764.008254] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784b82ed-04e5-4478-93e7-b8845b67d98e with Priority: HIGHEST for action port [ 764.008689] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.010022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.013112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.013112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.013112] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.013112] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.013112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.013112] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-784b82ed-04e5-4478-93e7-b8845b67d98e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.013112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.013112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.013112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.013112] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('784b82ed-04e5-4478-93e7-b8845b67d98e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.383825] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: SUCCESS [ 764.386695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.386902] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 764.387382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.387459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.387790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.388039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.388226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.388299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.388451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.388579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.388800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.388800] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.389816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.390045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.390255] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.390428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.390486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.390689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.390821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.390951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.391069] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.518023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.518023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 784b82ed-04e5-4478-93e7-b8845b67d98e with status ACTIVE [ 764.518023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.518023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.518023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.518023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.518588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.518588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.518588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.518588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.518588] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 784b82ed-04e5-4478-93e7-b8845b67d98e is going to be updated. [ 764.539908] env[65107]: INFO networking_nsxv3.common.synchronization [req-72389017-562e-4543-baa6-b2bdf7f7a98c req-2a4ac1c1-bdf5-4aab-b3af-0fc2fbb2c918 tempest-ServersAdminNegativeTestJSON-1455848825 tempest-ServersAdminNegativeTestJSON-1455848825-project-member] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 764.541540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.542241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.542241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.542241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.542241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.542745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-784b82ed-04e5-4478-93e7-b8845b67d98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.543195] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGHEST for action security_group_members [ 764.543997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.544359] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.544359] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.544625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.544748] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.545039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.545039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.545111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.545189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.545318] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.875571] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: SUCCESS [ 764.875792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.875970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.876232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.876452] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.876616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.876668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.876789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.876868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.876954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.877077] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.894385] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.897924] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.897924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.897924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.897924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.897924] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.897924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.897924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.899820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.899820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.899820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.900276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.900276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.900276] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.049574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.049733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.050192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.050276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.074500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.076017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.077666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.077801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.078045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.079046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.079046] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be updated. [ 765.117046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.117210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.117331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.117689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.117867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.137942] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: IN_PROGRESS for 2s [ 765.384178] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.401951] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd in Status: SUCCESS [ 765.402365] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd deletion is rescheduled due to dependency. [ 765.402902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.404283] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b0e1e5d-6b69-4241-b187-86836e4d9086: rpc.has_security_group_logging(os_id): False [ 765.406139] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8: rpc.has_security_group_logging(os_id): False [ 765.428031] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.428031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.428207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.428304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.430360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.430437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.451573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.451573] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.451573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.451573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.451573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.451573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.451913] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.451913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.452054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.452253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.453300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.453300] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.453300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.453300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.453300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.453300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.453300] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 765.454684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.454901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.455045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.455336] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.455499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.455611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.456403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.456403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.456403] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be created. [ 765.529759] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.529961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.530069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.530294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.530492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.545590] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: IN_PROGRESS for 2s [ 765.546877] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.547117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.547117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.547326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.547466] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.574501] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 765.840158] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 765.840158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.840158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.840158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.840158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.840158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.840158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.840158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.840158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.840605] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.891149] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 916be366-a55f-4f65-b259-ce2263c7c963: rpc.has_security_group_logging(os_id): False [ 765.909996] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.910177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.910239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.910455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.910545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.910794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.910901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.910987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.911149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.911230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.911402] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 is going to be created. [ 765.974961] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.975177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.975258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.975425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.975723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.992333] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: IN_PROGRESS for 2s [ 766.344078] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.734084] env[65107]: INFO networking_nsxv3.common.synchronization [req-c92c8ecd-25ee-41df-bac5-a7e8eb2adb2f req-11bf6bd9-e9c2-4a55-94f6-9ee4afbe049c tempest-ServerRescueTestJSONUnderV235-1324172596 tempest-ServerRescueTestJSONUnderV235-1324172596-project-member] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 766.735707] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGHEST for action security_group_members [ 766.736463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.736854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.737144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.737700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.738032] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.738310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.738730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.739032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.739227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.739492] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.849010] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.149154] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562b8388-027e-4f71-8ef8-2da4162f2318 in Status: SUCCESS [ 767.149346] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 deletion is rescheduled due to dependency. [ 767.149474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.243480] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.243480] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.243480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.243480] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be updated. [ 767.262780] env[65107]: INFO networking_nsxv3.common.synchronization [None req-596bbc4a-7d9c-4076-88c5-9946f6044ca1 None None] Enqueued Resource ID: 260857fe-8231-4519-9798-c3288c51dfb6 with Priority: HIGHEST for action port [ 767.263438] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260857fe-8231-4519-9798-c3288c51dfb6 with Priority: HIGHEST for action port [ 767.264732] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-260857fe-8231-4519-9798-c3288c51dfb6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.264938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-260857fe-8231-4519-9798-c3288c51dfb6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.265052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-260857fe-8231-4519-9798-c3288c51dfb6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.265786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-260857fe-8231-4519-9798-c3288c51dfb6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.266671] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('260857fe-8231-4519-9798-c3288c51dfb6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.276726] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.276726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.276726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.276726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.276726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.289599] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: IN_PROGRESS for 2s [ 767.353793] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.353793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.353793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.353793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.353793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.353793] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 767.385463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.385463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.385463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.385463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.385463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.397324] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 767.563023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: SUCCESS [ 767.563023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.591052] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 767.591286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.772033] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 260857fe-8231-4519-9798-c3288c51dfb6 [ 767.772033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.772033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.772033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.772407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.772407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.772407] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:260857fe-8231-4519-9798-c3288c51dfb6 already deleted. [ 767.772502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-260857fe-8231-4519-9798-c3288c51dfb6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.994422] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent loop - iteration:0 completed [ 767.994541] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent loop - iteration:1 started [ 768.007289] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: SUCCESS [ 768.007478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.304325] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 in Status: SUCCESS [ 769.304325] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 deletion is rescheduled due to dependency. [ 769.304325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.412494] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 769.412494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.412494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.412494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.412773] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.412831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.412948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.413058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.413183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.413231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.413317] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.828009] env[65107]: INFO networking_nsxv3.common.synchronization [req-0a74a40c-9469-47e5-a9d3-625946094550 req-00a1d5f7-89b4-4ff9-90e6-2c1d05a58284 tempest-FloatingIPsAssociationTestJSON-90781303 tempest-FloatingIPsAssociationTestJSON-90781303-project-member] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 769.828578] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 769.828877] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.829043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.829413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.829638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.829858] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.829972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.830050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.830211] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.830295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.830386] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.916565] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.916565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.916565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.916776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.916899] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.916952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.918507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.918507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.918507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.918507] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.071505] env[65107]: INFO networking_nsxv3.common.synchronization [None req-91f93a3a-8a2a-451f-a759-c5cb2fe07c0f tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 770.072170] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 770.073127] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.073127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.073316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.073648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.073648] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.077563] env[65107]: INFO networking_nsxv3.common.synchronization [None req-abf0b992-cf67-4ac9-a57c-cc3fb2c99451 None None] Enqueued Resource ID: fe168897-3860-42bc-9b6d-271a427a5d16 with Priority: HIGHEST for action port [ 770.078358] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe168897-3860-42bc-9b6d-271a427a5d16 with Priority: HIGHEST for action port [ 770.078663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe168897-3860-42bc-9b6d-271a427a5d16 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.079037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe168897-3860-42bc-9b6d-271a427a5d16" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.079037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe168897-3860-42bc-9b6d-271a427a5d16" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.079134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe168897-3860-42bc-9b6d-271a427a5d16" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.079166] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe168897-3860-42bc-9b6d-271a427a5d16',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.226794] env[65107]: INFO networking_nsxv3.common.synchronization [None req-76c3616b-a683-4922-9a67-14e34c7f95b8 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 770.227768] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 770.229525] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.229525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.332113] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.423473] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d43e6dbc-45c8-476b-af04-082906b1ad4d: rpc.has_security_group_logging(os_id): False [ 770.449722] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.450074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.450074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.451632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.475669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.476322] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.476462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.476530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.476775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.476871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.477261] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.477368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.477431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.480528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.480693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.481157] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.481327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.481433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.481685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.481793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.481906] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 770.582672] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe168897-3860-42bc-9b6d-271a427a5d16 [ 770.583149] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.583325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.583399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.583753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.583753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.583915] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe168897-3860-42bc-9b6d-271a427a5d16 already deleted. [ 770.583915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe168897-3860-42bc-9b6d-271a427a5d16" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.601342] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.601539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.601617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.601848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.602010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.609951] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.609951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.609951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.609951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.609951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.609951] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be already deleted. [ 770.609951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.609951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.609951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.609951] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.624126] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 770.837424] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.943456] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.943456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.943456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.944580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.944580] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.131563] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.131815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.131921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.132212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.132337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.132437] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be already deleted. [ 771.132532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.340239] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.340668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.340668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.340830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.340974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.341067] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be updated. [ 771.390806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.391050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.391219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.391357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.391583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.408939] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 2s [ 771.447688] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.937317] env[65107]: INFO networking_nsxv3.common.synchronization [req-604163f4-3b1c-4ad8-b427-9b471bdc6e08 req-7f4dacbd-5e33-4d5e-81d0-46b080c7f7d4 tempest-ServersTestFqdnHostnames-2005309367 tempest-ServersTestFqdnHostnames-2005309367-project-member] Enqueued Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_members [ 771.938320] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGHEST for action security_group_members [ 771.938463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.938633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.938732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.939022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.939233] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.939373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.939464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.939680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.939821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.939946] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.950769] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.442199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.443089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.443089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.443089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.452503] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 772.452621] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 772.467817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.468144] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.468524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.468524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.468674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.468674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.468758] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 is going to be updated. [ 772.498584] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.498784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.498784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.498991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.499148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.507867] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 in Status: IN_PROGRESS for 2s [ 772.623456] env[65107]: INFO networking_nsxv3.common.synchronization [req-c3a226e8-d2c7-45ac-999d-14d24b12499c req-092cb290-1cef-4b48-9f6a-84aa456cb313 tempest-ServerActionsV293TestJSON-867971376 tempest-ServerActionsV293TestJSON-867971376-project-member] Enqueued Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_members [ 772.623608] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_members [ 772.624181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9be39cfe-e706-4bf7-8816-70542b5cb472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.624181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.624181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.624993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.624993] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.624993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.624993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.624993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.625197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.625197] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.643061] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 772.643284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.004237] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7a9a4c8b-e1ef-44d4-99c8-2fabc412c191 None None] Enqueued Resource ID: 371be8e2-d1ae-4988-8548-3435b6817bf6 with Priority: HIGHEST for action port [ 773.004237] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371be8e2-d1ae-4988-8548-3435b6817bf6 with Priority: HIGHEST for action port [ 773.004237] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-371be8e2-d1ae-4988-8548-3435b6817bf6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.004237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-371be8e2-d1ae-4988-8548-3435b6817bf6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.004237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-371be8e2-d1ae-4988-8548-3435b6817bf6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.004237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-371be8e2-d1ae-4988-8548-3435b6817bf6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.004237] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('371be8e2-d1ae-4988-8548-3435b6817bf6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.086183] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.086362] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-126" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.086473] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-126" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.086840] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-126" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.087329] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.087530] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.087621] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.087895] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.088294] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.088538] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.088949] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.088949] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.088949] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.089097] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.089182] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.089363] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.110128] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.110308] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.110442] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.110612] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-126" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.110927] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-c35bebfe-bc73-4368-b22d-1c537c2ba92b taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.111573] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.111765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.112156] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.112328] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c35bebfe-bc73-4368-b22d-1c537c2ba92b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.129627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.129779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.129867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.130115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.130208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.130403] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.130506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.130568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.130714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.130789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.130870] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 already deleted. [ 773.130963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.274911] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.275333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.275419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.275640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.290767] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 773.291977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.293037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 773.322545] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.322893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.323122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.323404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.331419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.331419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 773.331419] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.331419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 773.372136] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.372322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.372322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.372526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.373605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.373877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 773.418510] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 773.418725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.443584] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.444022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.444022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.444022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.444324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.444489] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 773.498233] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.498453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.498564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.498863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.499176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.499481] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 773.499618] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2304da05-6fdb-4605-ba99-e497cf0fe331', '6970c294-30ba-4814-9be8-ff7a47ecd5e8', '72f456f5-8ebf-4a3f-9abe-b5b8150be76b', '20dddc20-b178-4d49-afa2-bbeaf4630ee9', 'de5bb9f6-dc07-4ba1-9bf0-e549fa218d60', '75e345bd-70c9-42fe-b74a-676b7bf1ce7f', 'd5a9e810-a93e-4373-b821-f175316f25f4', '2c33a4c9-c386-4629-b92a-71c04d7941cd', '57ccc978-a1f0-4c03-8296-5acfbdaf68e4', '44ae0e63-5c9b-464b-a6dd-e9e056e17006', '602f9ef3-38ee-4e8b-912d-c998fbcbbe73', '6801a112-5684-487c-b713-b3fc340c09d5', '001132af-7c6a-44dd-97d6-1576257d23bd', '155f8da9-bd0f-41ba-b11d-9ea39b0bca44', 'a2cc3c5b-5d64-430b-ba1a-61805cb1246f', '8764e835-f7cd-46d9-9326-fc9bab923c64', 'c60b9686-7de1-476f-8126-57c150974fec', '562b8388-027e-4f71-8ef8-2da4162f2318', '916be366-a55f-4f65-b259-ce2263c7c963', '80897378-8bb7-4165-aca0-4e8d0e40ed38', '78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9', '0b0e1e5d-6b69-4241-b187-86836e4d9086', 'c78203ee-b32f-401b-9764-682ada8423c6', '2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083', 'f472a668-4442-488d-936d-2a700ed0a421', 'ae409816-e898-46fe-b06e-b955dd9008ef', 'ed87eef5-439b-4752-b6cf-ead13a28e49a', '3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8', '4197bdde-e214-41a5-8235-df774396919e', 'd43e6dbc-45c8-476b-af04-082906b1ad4d', 'e382ab2d-f671-4098-ac12-6a8786603007', '560f9d77-f914-4f8b-bc22-1688e970b817', 'b2882833-81aa-4338-b54e-9f9cd3047983', '4a469b2f-9178-42b0-be36-f1370374e744'} {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.499735] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 773.507257] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 371be8e2-d1ae-4988-8548-3435b6817bf6 [ 773.507392] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.507484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.507521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.507724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.507866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.508952] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:371be8e2-d1ae-4988-8548-3435b6817bf6 already deleted. [ 773.508952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-371be8e2-d1ae-4988-8548-3435b6817bf6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.519905] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.520085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.520152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.520343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.520470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.520600] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 773.520703] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.520845] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 773.588177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.588341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.588382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.588590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.589253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.589454] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 773.589530] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.589599] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 773.589664] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 773.589739] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 773.589849] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGH for action security_group_rules [ 773.589905] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGH for action security_group_rules [ 773.589975] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGH for action security_group_rules [ 773.590050] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGH for action security_group_rules [ 773.590114] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGH for action security_group_rules [ 773.590175] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGH for action security_group_rules [ 773.590237] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGH for action security_group_rules [ 773.590298] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGH for action security_group_rules [ 773.590358] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGH for action security_group_rules [ 773.590419] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGH for action security_group_rules [ 773.590480] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGH for action security_group_rules [ 773.590540] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGH for action security_group_rules [ 773.590601] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGH for action security_group_rules [ 773.590660] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGH for action security_group_rules [ 773.590721] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGH for action security_group_rules [ 773.590793] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGH for action security_group_rules [ 773.590873] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGH for action security_group_rules [ 773.590938] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGH for action security_group_rules [ 773.591007] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGH for action security_group_rules [ 773.591076] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGH for action security_group_rules [ 773.591171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.614685] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.614974] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.615143] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.615457] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.615642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.615824] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port c35bebfe-bc73-4368-b22d-1c537c2ba92b not found, creating... [ 773.616159] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.616338] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.616481] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.616736] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.616900] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.617253] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.617440] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.617574] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.617848] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.617975] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.618139] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: c35bebfe-bc73-4368-b22d-1c537c2ba92b is going to be created. [ 773.641213] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.641462] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.641583] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.641884] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.642191] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.642450] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.409923] env[65107]: INFO networking_nsxv3.common.synchronization [req-c3a226e8-d2c7-45ac-999d-14d24b12499c req-b2366806-523c-4ded-9e87-f87f9ffd1f80 service nova] Enqueued Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_rules [ 774.410225] env[65107]: INFO networking_nsxv3.common.synchronization [req-c3a226e8-d2c7-45ac-999d-14d24b12499c req-b2366806-523c-4ded-9e87-f87f9ffd1f80 service nova] Enqueued Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_members [ 774.410410] env[65107]: INFO networking_nsxv3.common.synchronization [req-c3a226e8-d2c7-45ac-999d-14d24b12499c req-b2366806-523c-4ded-9e87-f87f9ffd1f80 service nova] Enqueued Resource ID: c35bebfe-bc73-4368-b22d-1c537c2ba92b with Priority: HIGHEST for action port [ 774.411070] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_rules [ 774.411384] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_members [ 774.413575] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35bebfe-bc73-4368-b22d-1c537c2ba92b with Priority: HIGHEST for action port [ 774.413707] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 with Priority: HIGH for action security_group_rules [ 774.413817] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGH for action security_group_rules [ 774.413918] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGH for action security_group_rules [ 774.414024] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGH for action security_group_rules [ 774.414120] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 with Priority: HIGH for action security_group_rules [ 774.414212] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGH for action security_group_rules [ 774.414301] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562b8388-027e-4f71-8ef8-2da4162f2318 with Priority: HIGH for action security_group_rules [ 774.414390] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60b9686-7de1-476f-8126-57c150974fec with Priority: HIGH for action security_group_rules [ 774.414478] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 with Priority: HIGH for action security_group_rules [ 774.414564] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 with Priority: HIGH for action security_group_rules [ 774.414655] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001132af-7c6a-44dd-97d6-1576257d23bd with Priority: HIGH for action security_group_rules [ 774.415069] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGH for action security_group_rules [ 774.415069] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 with Priority: HIGH for action security_group_rules [ 774.415069] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 with Priority: HIGH for action security_group_rules [ 774.419749] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGH for action security_group_rules [ 774.419964] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGH for action security_group_rules [ 774.420108] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd with Priority: HIGH for action security_group_rules [ 774.420218] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 with Priority: HIGH for action security_group_rules [ 774.420300] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGH for action security_group_rules [ 774.420392] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGH for action security_group_rules [ 774.420733] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9be39cfe-e706-4bf7-8816-70542b5cb472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.420890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.420958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.421181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.421329] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.426127] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9be39cfe-e706-4bf7-8816-70542b5cb472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.426127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.426127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.426328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.426487] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.427058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.427058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.427058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.427058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.427058] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.427902] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c35bebfe-bc73-4368-b22d-1c537c2ba92b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.428623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.428726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.429075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.429180] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c35bebfe-bc73-4368-b22d-1c537c2ba92b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.432771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2304da05-6fdb-4605-ba99-e497cf0fe331 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.433571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.433571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.433571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.433571] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2304da05-6fdb-4605-ba99-e497cf0fe331',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.435558] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.435706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.436644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.436871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.436951] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.437997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.438285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.438285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.438406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.438406] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.440788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.440788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.440788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.440788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.440788] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.441901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80897378-8bb7-4165-aca0-4e8d0e40ed38 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.442016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.442072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.442219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.442311] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80897378-8bb7-4165-aca0-4e8d0e40ed38',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.443360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.443458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.443522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.443769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.444058] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.446104] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562b8388-027e-4f71-8ef8-2da4162f2318 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.446237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.446237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.446707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.446707] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562b8388-027e-4f71-8ef8-2da4162f2318',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.447307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c60b9686-7de1-476f-8126-57c150974fec taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.447401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.447611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.447611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.447940] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c60b9686-7de1-476f-8126-57c150974fec',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.447975] env[65107]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 774.448656] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.448764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.448807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.448951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.449035] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('155f8da9-bd0f-41ba-b11d-9ea39b0bca44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.450015] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8764e835-f7cd-46d9-9326-fc9bab923c64 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.450140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.450189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.450329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.450400] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8764e835-f7cd-46d9-9326-fc9bab923c64',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.451207] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-001132af-7c6a-44dd-97d6-1576257d23bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.451541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.451541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.451541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.451708] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('001132af-7c6a-44dd-97d6-1576257d23bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.452480] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.452619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.452619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.453371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.453371] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.453733] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.453849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.453938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.454054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.454125] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('602f9ef3-38ee-4e8b-912d-c998fbcbbe73',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.454909] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.455189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.455189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.455706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.455706] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44ae0e63-5c9b-464b-a6dd-e9e056e17006',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.456081] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.456193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.456259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.456391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.456550] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.457547] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.457547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.457547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.457739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.457739] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.458660] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c33a4c9-c386-4629-b92a-71c04d7941cd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.458660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.458781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.459270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.459270] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c33a4c9-c386-4629-b92a-71c04d7941cd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.459713] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.459822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.459889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.460062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.460133] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5bb9f6-dc07-4ba1-9bf0-e549fa218d60',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.460352] env[65107]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 774.461115] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.461226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.461294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.461437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.461510] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.462322] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.462423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.462488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.462629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.462702] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.466769] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.661829] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 in Status: SUCCESS [ 774.661918] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 deletion is rescheduled due to dependency. [ 774.661974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.926381] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9be39cfe-e706-4bf7-8816-70542b5cb472 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.926668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.934078] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c35bebfe-bc73-4368-b22d-1c537c2ba92b with status ACTIVE [ 774.934184] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.934269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.934310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.936753] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.936753] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.936753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.936753] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c35bebfe-bc73-4368-b22d-1c537c2ba92b is going to be updated. [ 774.963641] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.963799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.963874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.964104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.964296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.964405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c35bebfe-bc73-4368-b22d-1c537c2ba92b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.964702] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.964804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.964867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.965032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.965181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.965306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.965341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.965457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.965532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.965610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.965695] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.975021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.975021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.975021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.975021] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.975884] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0e305c1-b7ad-448e-8677-1823a613e8b3 req-48eaa597-5a70-483e-bb9b-9e8d7ac233e6 tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 774.976505] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.977589] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 774.978435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.978836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.978836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.978836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.979037] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.979037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.979130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.979193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.979274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.979360] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.997171] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.997324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.997324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.997522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.019020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.019020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2304da05-6fdb-4605-ba99-e497cf0fe331 is going to be deleted. [ 775.105363] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.105596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.105752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.105993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.106114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.106237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2304da05-6fdb-4605-ba99-e497cf0fe331" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.108773] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_members [ 775.108948] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 775.109075] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 775.109597] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_members [ 775.109733] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 775.109833] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 775.110181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.110328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.110397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.110637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.110798] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.110940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.110991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.111184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.111226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.111311] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.112590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.112590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.112590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.112590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.112724] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.112763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.112925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.113030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.113030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.113159] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.116121] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.116200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.116244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.116387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.116530] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.116623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.116684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.116819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.117425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.117425] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.164246] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.164246] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.164246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.164246] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.165732] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.165862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.165932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.166121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.166632] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.166632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.166632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.166632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.166632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.166861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.166861] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.179316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.179487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.179541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.179987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.179987] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.179987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.180184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.180184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.180265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.180347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.180430] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.181636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.181636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.181636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.181887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.181887] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.181887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.181997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.182089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.182157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.182272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.182352] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.183196] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.183299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.185235] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.185235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.185235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.185235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.185235] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.185571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.185571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.185571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.185656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.185686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.186795] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.203438] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_rules [ 775.203619] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 775.203756] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 775.203895] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 775.204018] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_rules [ 775.204148] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_members [ 775.204375] env[65107]: INFO networking_nsxv3.common.synchronization [req-138b6508-af86-46d9-a502-4d584d0d9283 req-d081002e-73c3-41aa-8e61-bb270306235c tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea with Priority: HIGHEST for action port [ 775.208311] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_rules [ 775.208888] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_rules [ 775.208888] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_members [ 775.208888] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea with Priority: HIGHEST for action port [ 775.208888] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_rules [ 775.208888] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 775.209183] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 775.217936] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.217936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.217936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.218208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.218208] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.219576] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.220309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.220309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.220309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.220309] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.221057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.221057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.221248] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09350fa-f4ff-42b3-9406-b9f4595ecdea taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.221397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.221397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.221720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.221720] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09350fa-f4ff-42b3-9406-b9f4595ecdea',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.222486] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.222596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.222678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.222902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.222984] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.224073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.224198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.224429] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.224519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.232609] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.232812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.232812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.235155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.235155] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.235155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.236407] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.236484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.237274] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.237375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.248411] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.248613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.250478] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.250693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.252731] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.252891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.270627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.270757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.271663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.271781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.272669] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.272853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.273571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.273695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.275783] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 775.276372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.276493] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c60b9686-7de1-476f-8126-57c150974fec is going to be deleted. [ 775.277514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.277763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.337433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.337722] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5bb9f6-dc07-4ba1-9bf0-e549fa218d60 is going to be deleted. [ 775.338551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.338771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.365686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.365830] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8764e835-f7cd-46d9-9326-fc9bab923c64 is going to be deleted. [ 775.366881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.367130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.369698] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.369901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.387550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.387759] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562b8388-027e-4f71-8ef8-2da4162f2318 is going to be deleted. [ 775.389133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.389422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.414762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.414921] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44ae0e63-5c9b-464b-a6dd-e9e056e17006 is going to be deleted. [ 775.416169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.416461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.418450] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.418560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.441632] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.441762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.445813] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.446247] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.446247] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.446356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.446962] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.446962] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.446962] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.447230] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.447313] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.447514] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.447628] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.447748] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.447895] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.447972] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.448054] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.448261] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.455199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.455351] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 001132af-7c6a-44dd-97d6-1576257d23bd is going to be deleted. [ 775.456267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.456498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.477041] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.478723] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.479937] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.480187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.480263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.480736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.480909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.481256] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 is going to be created. [ 775.483281] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.488256] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.488381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.500237] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.500455] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.500618] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.500844] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.501231] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-2d4c2bee-36af-40dd-b10c-aae1073eb838 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.501440] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.501594] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.501983] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.502414] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d4c2bee-36af-40dd-b10c-aae1073eb838',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.616959] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.618028] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.619310] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.632489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.633411] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 155f8da9-bd0f-41ba-b11d-9ea39b0bca44 is going to be deleted. [ 775.633736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.633966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.655680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.655827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.655899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.656863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.656863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.658096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.658204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.671420] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.671420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.671420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.671420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.671420] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.671420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.671420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.671789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.671789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.671789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.671915] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.671915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.671990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.672112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.672268] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.672375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.672415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.672543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.672612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.672687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.672774] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.688254] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.692775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.692954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.693025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.693219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.693409] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.693504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.693571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.693711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.694180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.694180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.694180] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.694180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.694441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.694441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.694772] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.694772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.694772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.694772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.695048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.695048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.695048] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.696536] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 in Status: UNINITIALIZED for 2s [ 775.697033] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.702910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.702910] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be deleted. [ 775.703466] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.703588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.703588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.703792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.703953] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.705782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.705878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.706098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.706233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.706294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.707571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.707571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.707571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.707571] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.711095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.711095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.713571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.713571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.729374] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09350fa-f4ff-42b3-9406-b9f4595ecdea with status ACTIVE [ 775.729374] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.729374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.729374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.729374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.729643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.729643] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.729721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.729758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.729934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.730022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.730207] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.730299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.730357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.730488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.730550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.730635] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09350fa-f4ff-42b3-9406-b9f4595ecdea is going to be updated. [ 775.732498] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.732498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.732886] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.732886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.733201] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.733292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.752806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.753063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.766565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.766565] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 602f9ef3-38ee-4e8b-912d-c998fbcbbe73 is going to be deleted. [ 775.767599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.768088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.781523] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.781719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.781814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.782171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.782763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.782987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09350fa-f4ff-42b3-9406-b9f4595ecdea" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.808345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.808345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80897378-8bb7-4165-aca0-4e8d0e40ed38 is going to be deleted. [ 775.809229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.809368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.840025] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.840025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.854804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.854983] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c33a4c9-c386-4629-b92a-71c04d7941cd is going to be deleted. [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c60b9686-7de1-476f-8126-57c150974fec" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.857765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5bb9f6-dc07-4ba1-9bf0-e549fa218d60" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.858135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.858135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.858207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.858731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8764e835-f7cd-46d9-9326-fc9bab923c64" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.858731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.858731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.858731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.858940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562b8388-027e-4f71-8ef8-2da4162f2318" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.859980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.860190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.860294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.860420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44ae0e63-5c9b-464b-a6dd-e9e056e17006" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.861393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.861549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-001132af-7c6a-44dd-97d6-1576257d23bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-155f8da9-bd0f-41ba-b11d-9ea39b0bca44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.863223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.875143] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.875334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.875334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.875559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.875639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.875764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-602f9ef3-38ee-4e8b-912d-c998fbcbbe73" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.961505] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.961711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.961711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.962117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.962237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.962387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80897378-8bb7-4165-aca0-4e8d0e40ed38" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.979952] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.979952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.979952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.979952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.980143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.980173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c33a4c9-c386-4629-b92a-71c04d7941cd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.980405] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72f456f5-8ebf-4a3f-9abe-b5b8150be76b: rpc.has_security_group_logging(os_id): False [ 775.984081] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5a9e810-a93e-4373-b821-f175316f25f4: rpc.has_security_group_logging(os_id): False [ 775.986753] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.010373] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.010373] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 2d4c2bee-36af-40dd-b10c-aae1073eb838 not found, creating... [ 776.010373] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.010373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.010996] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.012797] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.013121] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.013468] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.015626] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.015626] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 2d4c2bee-36af-40dd-b10c-aae1073eb838 is going to be created. [ 776.021332] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.021665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.023456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.023456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.025858] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.025858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.063339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.063681] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.063799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.063873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.064070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.064157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.064248] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b is going to be updated. [ 776.065428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.065613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.076817] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.077351] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.077566] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.078029] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.078365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.078662] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.119474] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.120718] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.121817] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.132912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.133336] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.133461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.133517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.133737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.133816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.133944] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be updated. [ 776.174743] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e345bd-70c9-42fe-b74a-676b7bf1ce7f: rpc.has_security_group_logging(os_id): False [ 776.187442] env[65107]: INFO networking_nsxv3.common.synchronization [None req-55c9fc0c-6180-48c8-a1cf-bbf1d05a2a9e None None] Enqueued Resource ID: 34df6822-d210-4804-93bc-fd2b39838302 with Priority: HIGHEST for action port [ 776.188115] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34df6822-d210-4804-93bc-fd2b39838302 with Priority: HIGHEST for action port [ 776.188522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-34df6822-d210-4804-93bc-fd2b39838302 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.188656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34df6822-d210-4804-93bc-fd2b39838302" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.188737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34df6822-d210-4804-93bc-fd2b39838302" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.189213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34df6822-d210-4804-93bc-fd2b39838302" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.189336] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34df6822-d210-4804-93bc-fd2b39838302',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.190429] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 916be366-a55f-4f65-b259-ce2263c7c963: rpc.has_security_group_logging(os_id): False [ 776.201827] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6801a112-5684-487c-b713-b3fc340c09d5: rpc.has_security_group_logging(os_id): False [ 776.212561] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6970c294-30ba-4814-9be8-ff7a47ecd5e8: rpc.has_security_group_logging(os_id): False [ 776.213776] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20dddc20-b178-4d49-afa2-bbeaf4630ee9: rpc.has_security_group_logging(os_id): False [ 776.223057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.223247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.223310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.223492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.237243] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.237243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.238280] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.238398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.249520] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.250249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.267468] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.267642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.272481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.272644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.285709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.285709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.285871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.285920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.286292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.286292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.286446] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.286552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.286616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.286767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.286840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.287614] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.287614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.287614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.287614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.287614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.287614] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 776.288836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.289021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.331720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.332130] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.332448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.332448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.332676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.332788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.334775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.334775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.334775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.334775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.334775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.334775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.334775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.334775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.335183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.335183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.335183] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be updated. [ 776.336260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.336367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.336506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.338813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.339057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.369810] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: IN_PROGRESS for 2s [ 776.387906] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.388129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.416989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.417553] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.417553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.417553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.417796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.417796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.418168] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.418285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.418342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.418504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.418582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.418767] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.418850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.418969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.419133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.419202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.419425] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 776.420660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.420758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.482348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.482790] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.482898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.482988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.483230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.483324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.483440] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 is going to be updated. [ 776.484622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.484817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.484974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.486336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.486521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.489951] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.490289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.490289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.490398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.490486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.490584] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be updated. [ 776.512926] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.512926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.524364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.524705] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.524808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.524877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.528383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.528383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.528383] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be updated. [ 776.528383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.528383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.528383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.540546] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: IN_PROGRESS for 2s [ 776.567457] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.567609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.567687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.567950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.568119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.572253] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.572253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.572253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.572661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.572661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.575344] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 776.585972] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 776.591994] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.591994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.591994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.591994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.591994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.622221] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 776.625186] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.625186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.625186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.625186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.625186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.625186] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 776.626766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.627355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.627457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.627697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.627840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.629398] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc is going to be created. [ 776.630171] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.630409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.630409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.632384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.632384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.632835] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be updated. [ 776.641064] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 2s [ 776.672383] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.672711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.672711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.673188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.673569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.693730] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34df6822-d210-4804-93bc-fd2b39838302 [ 776.693956] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.694125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.694226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.694399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.694493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.694591] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34df6822-d210-4804-93bc-fd2b39838302 already deleted. [ 776.694786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34df6822-d210-4804-93bc-fd2b39838302" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.709748] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.709974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.710099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.710331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.710474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.713046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.713227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.713270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.713476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.713618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.715503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.715617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.715651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.715834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.715974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.717723] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.717878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.717920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.718144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.718300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.733602] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: IN_PROGRESS for 2s [ 776.735345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: IN_PROGRESS for 2s [ 776.736269] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 776.737184] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: UNINITIALIZED for 2s [ 776.742217] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: IN_PROGRESS for 2s [ 776.830146] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0e305c1-b7ad-448e-8677-1823a613e8b3 req-22586735-fbec-45e8-98d1-b8b620eea888 service nova] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_rules [ 776.830337] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0e305c1-b7ad-448e-8677-1823a613e8b3 req-22586735-fbec-45e8-98d1-b8b620eea888 service nova] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 776.830472] env[65107]: INFO networking_nsxv3.common.synchronization [req-a0e305c1-b7ad-448e-8677-1823a613e8b3 req-22586735-fbec-45e8-98d1-b8b620eea888 service nova] Enqueued Resource ID: 2d4c2bee-36af-40dd-b10c-aae1073eb838 with Priority: HIGHEST for action port [ 776.831034] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_rules [ 776.831260] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 776.831313] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4c2bee-36af-40dd-b10c-aae1073eb838 with Priority: HIGHEST for action port [ 776.832031] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.832031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.832031] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.832031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.832465] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d4c2bee-36af-40dd-b10c-aae1073eb838 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.833829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.833829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.833829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.833829] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d4c2bee-36af-40dd-b10c-aae1073eb838',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.335491] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d4c2bee-36af-40dd-b10c-aae1073eb838 with status ACTIVE [ 777.335860] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.336018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.336191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.336535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.336655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.337041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.337164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.337230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.337404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.337483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.337679] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.337775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.337883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.338073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.338152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.338224] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d4c2bee-36af-40dd-b10c-aae1073eb838 is going to be updated. [ 777.384581] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.385905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.385905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.385905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.385905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.385905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d4c2bee-36af-40dd-b10c-aae1073eb838" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.709343] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 in Status: SUCCESS [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.709343] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.709343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.709343] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.212061] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.386169] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: SUCCESS [ 778.386405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.559055] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 778.560029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.596267] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 778.596267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.596849] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 778.596849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.596936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.597157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.597351] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.597462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.597523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.597678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.598304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.598426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.598529] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.599587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.599764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.600035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.600143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.600204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.600364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.600490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.600583] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.640246] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 778.640869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.653633] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 778.653786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.716398] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9be39cfe-e706-4bf7-8816-70542b5cb472: rpc.has_security_group_logging(os_id): False [ 778.734635] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.734781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.734823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.735082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.735190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.735472] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.735596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.735656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.735817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.735877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.735947] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 is going to be created. [ 778.751095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 778.751374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.752178] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: SUCCESS [ 778.752396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.752891] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: SUCCESS [ 778.753272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.753272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.753468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.753647] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.753823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.753823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.753973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.754098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.754182] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.755209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.755348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.755442] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.755586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.755586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.755720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.756408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.756408] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.756697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.756898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.757360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.757360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.757360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.757666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.757666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.757666] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.761017] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 778.761017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.761642] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: SUCCESS [ 778.761819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.817335] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.817479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.817563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.817821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.818016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.834296] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 in Status: IN_PROGRESS for 2s [ 779.102791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.102958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.103310] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.262593] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.262984] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.265479] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.605935] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.769143] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.771908] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.775659] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.109494] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.109686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.109806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.110109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.110147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.110294] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be updated. [ 780.145992] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.146196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.146302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.146526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.146674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.158994] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 780.279368] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.279685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.279848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.280309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.281294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.281294] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc is going to be updated. [ 780.283656] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.283923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.283923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.284328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.284490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.284662] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 780.286591] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.286716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.286843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.287306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.287392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.287559] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be updated. [ 780.387632] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.388081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.388181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.388485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.388642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.391881] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.392052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.392093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.392293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.392626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.410947] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: IN_PROGRESS for 2s [ 780.412431] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: IN_PROGRESS for 2s [ 780.417799] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.418261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.418438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.418822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.419200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.435813] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 780.852322] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 in Status: SUCCESS [ 780.852322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.833156] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 781.833156] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=9 [ 782.171975] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 782.171975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.171975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.172419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.172475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.172630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.172697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.173532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.173532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.173532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.173532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.173532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.173532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.173532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.174024] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.174024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.174024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.174024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.174024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.174432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.174605] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.206467] env[65107]: INFO networking_nsxv3.common.synchronization [req-6bd979b6-9f81-4e11-8779-383e32f6fd38 req-e59e0122-2c51-4b05-bf13-95aab7901c1b tempest-MigrationsAdminTest-1967309458 tempest-MigrationsAdminTest-1967309458-project-member] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 782.206467] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 782.206467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.206467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.206467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.208210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.208210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.208385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.208385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.208676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.210184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.210184] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.428167] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: SUCCESS [ 782.428344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.429197] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: SUCCESS [ 782.429337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.429492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.429656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.430832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.430832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.430832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.430832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.430832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.430832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.431155] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.432873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.432873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.432873] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.432873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.433421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.433421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.433421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.433421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.434988] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.448817] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 782.449038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.449695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.449973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.450649] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.450649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.450649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.451355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.451355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.451622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.451678] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.668764] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.668990] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.669132] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.669402] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.670087] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.670278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.670394] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.670619] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.670763] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.670976] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.671127] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.671232] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.671336] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.671441] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.671543] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.671668] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.677066] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cc3c5b-5d64-430b-ba1a-61805cb1246f: rpc.has_security_group_logging(os_id): False [ 782.692638] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.692872] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.692927] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.693203] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-731" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.693551] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-e272e693-1436-4af9-a009-668ee7e2fd4d taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.693781] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.693861] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.694202] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.694340] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e272e693-1436-4af9-a009-668ee7e2fd4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.696814] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.696933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.696986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.697196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.712306] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.717028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.717325] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.717456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.717522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.717716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.717801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.718013] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.718122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.718180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.718326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.718399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.718591] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.718694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.718774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.718921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.718997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.719095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be updated. [ 782.790042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.790293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.790407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.790666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.790833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.803674] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 782.935986] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.938196] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.954598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.954768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.954895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.955080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.955271] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.955383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.955449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.955615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.955805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.955805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.955970] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.956086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.956154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.956309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.956458] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.956581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.956671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.956825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.956912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.957014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.957116] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.200669] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.201073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.201073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.201339] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.201505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.201809] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port e272e693-1436-4af9-a009-668ee7e2fd4d not found, creating... [ 783.202039] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.202221] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.202390] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.202625] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.202765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.203063] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.203225] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.203337] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.203563] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.203694] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.203831] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: e272e693-1436-4af9-a009-668ee7e2fd4d is going to be created. [ 783.214818] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.226602] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.226990] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.227324] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.227712] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.228066] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.228412] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.441083] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b0e1e5d-6b69-4241-b187-86836e4d9086: rpc.has_security_group_logging(os_id): False [ 783.442343] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0f0ae8-be00-4206-98a1-2e29bf816ffc: rpc.has_security_group_logging(os_id): False [ 783.459061] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8: rpc.has_security_group_logging(os_id): False [ 783.463138] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.463319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.463365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.463651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.465405] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.465516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.478237] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.478412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.483141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.483453] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.483555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.483622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.483816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.483899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.484064] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be updated. [ 783.484998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.485181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.485267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.485470] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.485558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.485621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.485757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.485832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.485910] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc is going to be created. [ 783.487260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.487420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.507555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.507812] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.508246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.508246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.508423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.508504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.508737] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.508886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.508975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.509191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.509274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.509488] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.509583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.509670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.509785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.509860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.510044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 783.585552] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.585729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.585817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.586076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.586361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.588448] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.588602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.588763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.588903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.589116] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.606745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.606931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.606987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.607386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.607581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.615037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: IN_PROGRESS for 2s [ 783.629624] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: IN_PROGRESS for 2s [ 783.652937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 783.718754] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.718943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.719080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.719436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.719693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.719693] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4197bdde-e214-41a5-8235-df774396919e is going to be updated. [ 783.771738] env[65107]: INFO networking_nsxv3.common.synchronization [req-44b016fb-50d7-4a99-9ab6-4605a4174601 req-fb358860-8513-4d1d-afde-0e2596d15a37 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 783.771917] env[65107]: INFO networking_nsxv3.common.synchronization [req-44b016fb-50d7-4a99-9ab6-4605a4174601 req-fb358860-8513-4d1d-afde-0e2596d15a37 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_members [ 783.772061] env[65107]: INFO networking_nsxv3.common.synchronization [req-44b016fb-50d7-4a99-9ab6-4605a4174601 req-fb358860-8513-4d1d-afde-0e2596d15a37 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 783.772926] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 783.772926] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGHEST for action security_group_members [ 783.772926] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGHEST for action security_group_members [ 783.773249] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.773378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.773446] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.773665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.773828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.773932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.773987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.774197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.774289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.774400] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.775373] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.775537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.775537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.775698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.775844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.775924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.775983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.776144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.776221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.776305] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.778155] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.778288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.778336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.779229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.779229] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.779229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.779229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.779229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.779229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.779229] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.782331] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.782537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.782615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.782872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.783106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.795088] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: IN_PROGRESS for 2s [ 783.946454] env[65107]: INFO networking_nsxv3.common.synchronization [req-6bd979b6-9f81-4e11-8779-383e32f6fd38 req-44f82d79-d5fd-4523-bddb-99dc2dc13f34 service nova] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_rules [ 783.946454] env[65107]: INFO networking_nsxv3.common.synchronization [req-6bd979b6-9f81-4e11-8779-383e32f6fd38 req-44f82d79-d5fd-4523-bddb-99dc2dc13f34 service nova] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 783.946454] env[65107]: INFO networking_nsxv3.common.synchronization [req-6bd979b6-9f81-4e11-8779-383e32f6fd38 req-44f82d79-d5fd-4523-bddb-99dc2dc13f34 service nova] Enqueued Resource ID: e272e693-1436-4af9-a009-668ee7e2fd4d with Priority: HIGHEST for action port [ 783.946454] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_rules [ 783.946454] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 783.946678] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e272e693-1436-4af9-a009-668ee7e2fd4d with Priority: HIGHEST for action port [ 783.946850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.946939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.946990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.947255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.947335] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.949335] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.949335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.949335] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e272e693-1436-4af9-a009-668ee7e2fd4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.949335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.949335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.949335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.949335] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e272e693-1436-4af9-a009-668ee7e2fd4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.152483] env[65107]: INFO networking_nsxv3.common.synchronization [req-bf59753c-1993-467c-8711-5f3b15315b62 req-39c7506b-e553-4a7a-b81a-36aaf3cb33fd tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 784.153225] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 784.153483] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.154513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.154622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.154824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.155027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.155123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.155285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.155447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.155574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.155766] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.282648] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.282932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.282932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.283065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.283321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.283457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.283742] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.283873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.283985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.284250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.284395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.284547] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc is going to be updated. [ 784.286805] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.287394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.287394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.287527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.288621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.288927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.289141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.289276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.289759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.290011] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.290133] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be updated. [ 784.343285] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.343500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.343500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.343711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.343853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.345791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.346224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.346224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.346342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.346952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.359303] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: IN_PROGRESS for 2s [ 784.360262] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: IN_PROGRESS for 2s [ 784.451490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.452144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.454295] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e272e693-1436-4af9-a009-668ee7e2fd4d with status ACTIVE [ 784.454295] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.454295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.454295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.454295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.454484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.454583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.454730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.454825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.455117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.455229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.455710] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.455710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.455875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.457044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.457044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.457044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e272e693-1436-4af9-a009-668ee7e2fd4d is going to be updated. [ 784.479087] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.479198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.479239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.479435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.479562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.479726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e272e693-1436-4af9-a009-668ee7e2fd4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.658673] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.658842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.658919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.660047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.660047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.660047] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.660047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.660047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.660047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.660047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.660047] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 784.691304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.691829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.691829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.691829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.691938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.703024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 784.787087] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.822035] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 784.822171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.822290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.822500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.822842] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.290930] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.290930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.290930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.290930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.290930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.290930] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 785.324850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.325146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.325146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.325604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.325940] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.326019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.326068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.326443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.326443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.326443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.326684] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.357041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.357041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.357428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.357428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.357428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.376754] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 785.631564] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: SUCCESS [ 785.631945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.654022] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: SUCCESS [ 785.654264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.685023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 785.685257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.807200] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: SUCCESS [ 785.807200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.807338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.807867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.807867] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.808183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.808183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.808183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.808279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.808389] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.829226] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.829439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.829515] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.829730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.829904] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.830112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.830257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.830445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.830540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.830634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.830803] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.830902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.830964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.831174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.831322] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.831447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.831546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.831626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.831676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.831753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.831841] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.311814] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.335158] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cc3c5b-5d64-430b-ba1a-61805cb1246f: rpc.has_security_group_logging(os_id): False [ 786.364403] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.364403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.364403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.364403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.364403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.364748] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.364748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.364748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.364850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.364885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.365094] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.365315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.365380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.365531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.365608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.365807] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.365938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.365938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.366133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.366293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.366386] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be updated. [ 786.379626] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 in Status: SUCCESS [ 786.379903] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 deletion is rescheduled due to dependency. [ 786.380195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.381479] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc in Status: SUCCESS [ 786.381761] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc deletion is rescheduled due to dependency. [ 786.382049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.463439] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.463695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.463805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.464109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.464337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.481210] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 786.713990] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 786.714240] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 786.714367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.814114] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.150133] env[65107]: INFO networking_nsxv3.common.synchronization [req-49e41e76-b527-4ffa-aec9-b464078739ec req-19abea5f-6b6c-4906-9f2d-60b6f9ff2f44 tempest-InstanceActionsNegativeTestJSON-1703998576 tempest-InstanceActionsNegativeTestJSON-1703998576-project-member] Enqueued Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_members [ 787.150133] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_members [ 787.150395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.150561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.150654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.151035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.151264] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.151404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.151495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.151693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.152419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.152419] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.319866] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.319866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.319866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.319866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.319866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.319866] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4197bdde-e214-41a5-8235-df774396919e is going to be updated. [ 787.358873] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.359093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.359156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.359413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.359561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.369823] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: IN_PROGRESS for 2s [ 787.387696] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 787.387933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.587205] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.587598] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-677" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.587598] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-677" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.587873] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-677" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.588592] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.588766] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.588883] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.589118] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.589278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.589513] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.589649] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.589736] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.589841] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.589947] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.590088] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.590230] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.612587] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.612805] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 787.612990] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.613185] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-677" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.613580] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-418258f2-fc7e-4098-8bdc-99c336426a92 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.613758] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.613875] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.614263] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.614427] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('418258f2-fc7e-4098-8bdc-99c336426a92',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.654646] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.654803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.654874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.655195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.655309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.655534] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.655636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.655699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.655869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.655950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.656051] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9125373b-7375-4872-9f2e-c95f9102b178 already deleted. [ 787.656139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.119105] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.119558] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.119985] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.120420] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.120691] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.120964] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 418258f2-fc7e-4098-8bdc-99c336426a92 not found, creating... [ 788.122035] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.122035] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.122035] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.122035] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.125070] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.125070] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.125070] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.125070] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.125070] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.125070] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.125070] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 418258f2-fc7e-4098-8bdc-99c336426a92 is going to be created. [ 788.147425] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.149010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.149010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.149010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.149010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.149010] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.496166] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 788.496545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.647420] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4c8da4ec-c3ff-4033-8100-e13cc1325f34 None None] Enqueued Resource ID: 2ac53103-dfca-49e2-9e22-f33914039c93 with Priority: HIGHEST for action port [ 788.648012] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac53103-dfca-49e2-9e22-f33914039c93 with Priority: HIGHEST for action port [ 788.648344] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ac53103-dfca-49e2-9e22-f33914039c93 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.648471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ac53103-dfca-49e2-9e22-f33914039c93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.648537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ac53103-dfca-49e2-9e22-f33914039c93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.648793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ac53103-dfca-49e2-9e22-f33914039c93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.648874] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac53103-dfca-49e2-9e22-f33914039c93',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.840734] env[65107]: INFO networking_nsxv3.common.synchronization [req-49e41e76-b527-4ffa-aec9-b464078739ec req-093f2217-dd32-4e61-9fcb-0860b1f6672a service nova] Enqueued Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_rules [ 788.840911] env[65107]: INFO networking_nsxv3.common.synchronization [req-49e41e76-b527-4ffa-aec9-b464078739ec req-093f2217-dd32-4e61-9fcb-0860b1f6672a service nova] Enqueued Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_members [ 788.841085] env[65107]: INFO networking_nsxv3.common.synchronization [req-49e41e76-b527-4ffa-aec9-b464078739ec req-093f2217-dd32-4e61-9fcb-0860b1f6672a service nova] Enqueued Resource ID: 418258f2-fc7e-4098-8bdc-99c336426a92 with Priority: HIGHEST for action port [ 788.841623] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_rules [ 788.841756] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_members [ 788.841886] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 418258f2-fc7e-4098-8bdc-99c336426a92 with Priority: HIGHEST for action port [ 788.842207] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.842324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.842503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.842672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.842756] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.843606] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.843713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.843784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.843963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.844154] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.844204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.844245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.844378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.844464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.844551] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.845372] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-418258f2-fc7e-4098-8bdc-99c336426a92 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.845434] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.845465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.845594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.845667] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('418258f2-fc7e-4098-8bdc-99c336426a92',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.152207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ac53103-dfca-49e2-9e22-f33914039c93 [ 789.152424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.152572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.152572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.152855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.152855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.152934] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ac53103-dfca-49e2-9e22-f33914039c93 already deleted. [ 789.153062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ac53103-dfca-49e2-9e22-f33914039c93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.352201] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.352201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.352201] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.352625] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 418258f2-fc7e-4098-8bdc-99c336426a92 with status ACTIVE [ 789.352625] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.352715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.352715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.352981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.353050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.353264] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.353361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.353481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.353593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.353682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.353876] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.355040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.355132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.355344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.355483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.355554] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 418258f2-fc7e-4098-8bdc-99c336426a92 is going to be updated. [ 789.383980] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.384209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.384209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.384489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.384698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.384878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-418258f2-fc7e-4098-8bdc-99c336426a92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.385721] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: SUCCESS [ 789.385952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.386076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.386259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.386437] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.386546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.386608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.386760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.386834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.386998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.387077] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.771411] env[65107]: INFO networking_nsxv3.common.synchronization [req-44078d58-6ec1-4eae-9b75-67ec5e162aa5 req-0b674526-46d4-47cb-a20a-7e40dd3e1ad7 tempest-ServersNegativeTestJSON-35009868 tempest-ServersNegativeTestJSON-35009868-project-member] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 789.772104] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 789.772301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.772486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.772552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.772787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.772943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.773067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.773137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.773295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.773380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.773472] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.858694] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.889900] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.890108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.890209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.890448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.890622] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.890726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.890792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.890942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.891040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.891128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.891300] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.891408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.891470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.891611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.891752] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.891841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.892157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.892157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.892157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.892310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.892310] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.180777] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-352 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.181100] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.181286] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.181935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.182524] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.182739] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.182886] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.183290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.183499] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.183787] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.183935] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.184082] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.184220] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.184356] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.184500] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.184660] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.204835] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.206146] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.206146] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.206146] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.206146] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-bddde8fd-659f-44ac-99c5-739567bc218e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.206146] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.206406] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.206615] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.206652] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bddde8fd-659f-44ac-99c5-739567bc218e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.276161] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.276380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.276538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.276896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.277081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.277415] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.278044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.278044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.278044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.278044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.278316] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 already deleted. [ 790.278316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.361510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.361924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.362220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.362905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.362905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.362905] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9125373b-7375-4872-9f2e-c95f9102b178 is going to be created. [ 790.398916] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4197bdde-e214-41a5-8235-df774396919e: rpc.has_security_group_logging(os_id): False [ 790.426658] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.426805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.426875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.427104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.454718] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.454718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.454718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.454718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.454718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.467344] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9125373b-7375-4872-9f2e-c95f9102b178 in Status: UNINITIALIZED for 2s [ 790.469110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.469393] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.469543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.469592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.469774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.469878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.471039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.471039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.471039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.471039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.471039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.471039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.471039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.471039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.471458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.471458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.471458] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4197bdde-e214-41a5-8235-df774396919e is going to be updated. [ 790.560220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.560612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.560722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.560983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.561196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.578417] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: IN_PROGRESS for 2s [ 790.710247] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.711068] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.711068] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.711068] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.711248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.712399] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port bddde8fd-659f-44ac-99c5-739567bc218e not found, creating... [ 790.712399] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.712707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.712707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.713398] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.713398] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.713509] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.713660] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.713826] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.714068] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.714205] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.714341] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: bddde8fd-659f-44ac-99c5-739567bc218e is going to be created. [ 790.743442] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.743731] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.743892] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.744216] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.744749] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.745206] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.132094] env[65107]: INFO networking_nsxv3.common.synchronization [None req-a8af18ec-4117-4943-97da-95c6a21d6e11 None None] Enqueued Resource ID: 4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4 with Priority: HIGHEST for action port [ 791.132550] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4 with Priority: HIGHEST for action port [ 791.132746] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.132874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.133772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.133772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.134193] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.553917] env[65107]: INFO networking_nsxv3.common.synchronization [req-44078d58-6ec1-4eae-9b75-67ec5e162aa5 req-3531cfc8-1b20-49d0-bbcf-86eb677dd683 service nova] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_rules [ 791.553917] env[65107]: INFO networking_nsxv3.common.synchronization [req-44078d58-6ec1-4eae-9b75-67ec5e162aa5 req-3531cfc8-1b20-49d0-bbcf-86eb677dd683 service nova] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 791.553917] env[65107]: INFO networking_nsxv3.common.synchronization [req-44078d58-6ec1-4eae-9b75-67ec5e162aa5 req-3531cfc8-1b20-49d0-bbcf-86eb677dd683 service nova] Enqueued Resource ID: bddde8fd-659f-44ac-99c5-739567bc218e with Priority: HIGHEST for action port [ 791.553917] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_rules [ 791.553917] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 791.553917] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bddde8fd-659f-44ac-99c5-739567bc218e with Priority: HIGHEST for action port [ 791.553917] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.553917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.553917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.553917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.553917] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.555551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.555551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.555707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.555782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.555932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.556226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.556226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.556361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.556453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.556548] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.558236] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-bddde8fd-659f-44ac-99c5-739567bc218e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.558236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.558236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.558661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.558661] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bddde8fd-659f-44ac-99c5-739567bc218e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.636883] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4 [ 791.637151] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.637499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.637499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.637626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.637664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.637821] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4 already deleted. [ 791.637901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eaa21c9-40ff-4ea4-86d7-91ebc5fb70b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.060320] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.061713] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.061713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.061892] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bddde8fd-659f-44ac-99c5-739567bc218e with status ACTIVE [ 792.061940] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.062100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.062142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.062382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.062500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.063325] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.063325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.063325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.063325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.063993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.065019] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.065019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.065019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.065019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.065019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.065019] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bddde8fd-659f-44ac-99c5-739567bc218e is going to be updated. [ 792.088654] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.088798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.088872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.089458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.089458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.089458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.480008] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9125373b-7375-4872-9f2e-c95f9102b178 in Status: SUCCESS [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.480008] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.480008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.480008] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.562977] env[65107]: INFO networking_nsxv3.common.synchronization [req-cd79a8fa-c4bf-4ea4-9968-fd43a21611c8 req-d4afb69b-a08f-4b9a-b705-90b0f7f78f4f tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 792.563302] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 792.563865] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.563865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.563865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.564097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.564167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.564266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.564325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.564629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.564629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.564629] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.567690] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.593609] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: SUCCESS [ 792.593821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.966138] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.966138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.966138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.966138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.966138] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.966138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.966138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.966584] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.966798] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.967053] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.967222] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.967364] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.967493] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.967627] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.967759] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.967922] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.982535] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.982758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.982758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.982988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.983181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.983272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.983340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.983518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.983605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.983706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.983858] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.983951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.984018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.984155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.984378] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.984777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.984777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.984777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.984777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.984975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.984975] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.990860] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.990978] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 792.991144] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.991470] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.991676] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-cf1c9686-3af8-4248-968f-7b416c1d2692 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.991856] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.992038] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.992360] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.992512] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf1c9686-3af8-4248-968f-7b416c1d2692',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.073056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.073056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.073056] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be deleted. [ 793.073056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.073056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.074098] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be created. [ 793.101166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.101421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.101556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.101843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.102029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.111112] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.111364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.111776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.111776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.111948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.112041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.114641] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: UNINITIALIZED for 2s [ 793.488274] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9125373b-7375-4872-9f2e-c95f9102b178: rpc.has_security_group_logging(os_id): False [ 793.494574] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.494799] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.494994] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.495277] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.495431] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.495585] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port cf1c9686-3af8-4248-968f-7b416c1d2692 not found, creating... [ 793.495897] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.496076] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.496200] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.496422] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.496556] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.496864] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.496995] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.497121] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.497329] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.497450] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.497583] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: cf1c9686-3af8-4248-968f-7b416c1d2692 is going to be created. [ 793.516823] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.517100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.517100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.517384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.517484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.517711] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.518044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.518044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.518293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.518389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.518617] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.518758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.518875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.519144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.519144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.519391] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.519583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.519823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.520048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.520370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.520844] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9125373b-7375-4872-9f2e-c95f9102b178 is going to be created. [ 793.538084] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.538084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.538084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.538084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.538084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.538084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.590909] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.591222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.591513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.591772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.591966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.608542] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9125373b-7375-4872-9f2e-c95f9102b178 in Status: IN_PROGRESS for 2s [ 794.256508] env[65107]: INFO networking_nsxv3.common.synchronization [req-cd79a8fa-c4bf-4ea4-9968-fd43a21611c8 req-17684dd6-ed96-42a2-9351-0383d5ff35e6 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 794.257134] env[65107]: INFO networking_nsxv3.common.synchronization [req-cd79a8fa-c4bf-4ea4-9968-fd43a21611c8 req-17684dd6-ed96-42a2-9351-0383d5ff35e6 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 794.257134] env[65107]: INFO networking_nsxv3.common.synchronization [req-cd79a8fa-c4bf-4ea4-9968-fd43a21611c8 req-17684dd6-ed96-42a2-9351-0383d5ff35e6 service nova] Enqueued Resource ID: cf1c9686-3af8-4248-968f-7b416c1d2692 with Priority: HIGHEST for action port [ 794.257469] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 794.258021] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 794.258021] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf1c9686-3af8-4248-968f-7b416c1d2692 with Priority: HIGHEST for action port [ 794.258152] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.258256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.258318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.258623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.258623] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.259514] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.260106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.260106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.260106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.260106] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.260106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.260325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.260325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.260395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.260541] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.261425] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf1c9686-3af8-4248-968f-7b416c1d2692 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.261425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.261646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.261681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.261747] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf1c9686-3af8-4248-968f-7b416c1d2692',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.764296] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.764678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.764678] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf1c9686-3af8-4248-968f-7b416c1d2692 with status ACTIVE [ 794.764824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.765026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.765026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.765225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.765369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.765495] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.765598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.765646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.765810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.765901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.766103] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.766231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.766307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.766426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.766555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.766607] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf1c9686-3af8-4248-968f-7b416c1d2692 is going to be updated. [ 794.767876] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.793695] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.793876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.793919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.794120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.794254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.794450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf1c9686-3af8-4248-968f-7b416c1d2692" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.128187] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 795.128450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.128637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.128865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.129533] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.129700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.129804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.130085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.130366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.130528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.130640] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.272970] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.622291] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9125373b-7375-4872-9f2e-c95f9102b178 in Status: SUCCESS [ 795.622619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.633604] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.633689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.633722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.633935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.634126] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.634230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.634290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.634450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.634533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.634615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.634760] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.634849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.634906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.635058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.635195] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.635305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.635364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.635499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.635571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.635648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.635735] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.776651] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.776651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.776651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.776651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.780107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.780107] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be created. [ 795.805063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.805063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.805227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.805360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.805547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.818244] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: UNINITIALIZED for 2s [ 796.139713] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2bd5d37-9901-465a-8751-6c1cb28889e3: rpc.has_security_group_logging(os_id): False [ 796.161166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.161166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.161166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.162439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.162439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.162713] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.162852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.162936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.163146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.163453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.163695] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.164524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.164524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.164524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.164524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.164524] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.164524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.164524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.164913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.164913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.164913] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be created. [ 796.237470] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.237696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.237820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.238633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.238633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.296679] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 797.828557] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 797.828969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.829102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.829355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.829510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.829631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.829692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.829840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.829915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.829999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.830102] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.316319] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 798.316624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.332981] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.333273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.333374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.333723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.333927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.334256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.335035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.335671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.335857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.336072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.336333] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.336484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.336574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.337436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.337707] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.337773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.337825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.338114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.339891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.339891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.339891] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.842920] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57ccc978-a1f0-4c03-8296-5acfbdaf68e4: rpc.has_security_group_logging(os_id): False [ 798.869724] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.871681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.871681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.871681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.871681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.871681] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.872218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.872381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.872639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.872785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.872965] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.873095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.873201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.873337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.873418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.873637] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.873743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.873793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.873924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.874008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.874113] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be created. [ 798.983199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.983199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.983521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.983576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.983804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.011025] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 799.259118] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 799.259335] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 800.817059] env[65107]: INFO networking_nsxv3.common.synchronization [req-13f6365d-6c0c-4d02-90c0-9010dff5394b req-972d44ea-fad4-45d2-9422-ab359ef16213 tempest-ServersTestBootFromVolume-1621330954 tempest-ServersTestBootFromVolume-1621330954-project-member] Enqueued Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_members [ 800.818032] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_members [ 800.818489] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.818779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.819542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.819542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.819542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.819542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.819542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.819782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.819782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.819868] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.030791] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 801.030791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.278027] env[65107]: INFO networking_nsxv3.common.synchronization [req-85e6f2db-82f2-4767-8553-fb965ea39cbd req-726e9ffa-598e-4f36-bb27-090151fddfb0 tempest-ListImageFiltersTestJSON-1797771645 tempest-ListImageFiltersTestJSON-1797771645-project-member] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 801.278027] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 801.278606] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.278725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.278725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.279023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.279701] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.279701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.279701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.279701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.279874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.279874] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.322983] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.323571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.323783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.324082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.324190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.324467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.324632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.324706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.324819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.324910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.325051] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 already deleted. [ 801.325144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.344900] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.345189] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-334" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.345332] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-334" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.345773] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-334" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.346186] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.346286] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.346433] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.346681] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.346824] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.347042] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.347168] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.347277] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.347383] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.347504] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.347606] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.347752] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.373736] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.373917] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.374098] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.374331] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-334" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.374681] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-17e1664b-1b8f-4943-9e8b-87219c803171 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.374864] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.374982] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.375417] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.375628] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e1664b-1b8f-4943-9e8b-87219c803171',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.786562] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.879069] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.879488] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.879488] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.879694] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.879870] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.880032] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 17e1664b-1b8f-4943-9e8b-87219c803171 not found, creating... [ 801.880393] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.880581] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.880694] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.880910] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.881054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.881338] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.881479] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.881589] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.881785] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.881911] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.882573] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 17e1664b-1b8f-4943-9e8b-87219c803171 is going to be created. [ 801.903601] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.904109] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.904293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.904648] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.904940] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.905191] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.077784] env[65107]: INFO networking_nsxv3.common.synchronization [req-23e282b0-3f16-49a8-8464-4e69aede0abb req-9af8a768-2a75-4586-ba1f-a4d6672e8b08 tempest-ListServersNegativeTestJSON-227968552 tempest-ListServersNegativeTestJSON-227968552-project-member] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 802.078863] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 802.079281] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.079488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.079568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.079786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.079952] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.080063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.080149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.080386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.080509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.080628] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.292521] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.582415] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.680860] env[65107]: INFO networking_nsxv3.common.synchronization [req-13f6365d-6c0c-4d02-90c0-9010dff5394b req-e6c16e49-1628-4d46-9672-6c05e432e594 service nova] Enqueued Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_rules [ 802.680860] env[65107]: INFO networking_nsxv3.common.synchronization [req-13f6365d-6c0c-4d02-90c0-9010dff5394b req-e6c16e49-1628-4d46-9672-6c05e432e594 service nova] Enqueued Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_members [ 802.681043] env[65107]: INFO networking_nsxv3.common.synchronization [req-13f6365d-6c0c-4d02-90c0-9010dff5394b req-e6c16e49-1628-4d46-9672-6c05e432e594 service nova] Enqueued Resource ID: 17e1664b-1b8f-4943-9e8b-87219c803171 with Priority: HIGHEST for action port [ 802.681673] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_rules [ 802.681860] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_members [ 802.682024] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17e1664b-1b8f-4943-9e8b-87219c803171 with Priority: HIGHEST for action port [ 802.682640] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.682812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.682907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.683213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.683270] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.684523] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.684523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.684714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.685418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.685418] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.685418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.685418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.685418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.685418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.685653] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.686398] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-17e1664b-1b8f-4943-9e8b-87219c803171 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.686535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.686621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.686793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.686896] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e1664b-1b8f-4943-9e8b-87219c803171',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.795105] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.795273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.795344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.795559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.795748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.795748] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be updated. [ 802.848554] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.848653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.848690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.848881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.849141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.858605] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: IN_PROGRESS for 2s [ 802.989259] env[65107]: INFO networking_nsxv3.common.synchronization [req-6c6351fe-1405-4627-80ca-ad8373215b30 req-66474ddb-96df-43ff-aa37-2c3882f7359a tempest-InstanceActionsNegativeTestJSON-1703998576 tempest-InstanceActionsNegativeTestJSON-1703998576-project-member] Enqueued Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_members [ 802.989259] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGHEST for action security_group_members [ 802.989907] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.990233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.990464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.990786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.991090] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.991353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.991610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.992995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.992995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.992995] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.085113] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.175555] env[65107]: INFO networking_nsxv3.common.synchronization [req-1a5f2d9e-1a22-4abb-880f-fb99da447b4b req-fa42d061-cc7e-4937-b36d-f2986b977097 tempest-ListServersNegativeTestJSON-227968552 tempest-ListServersNegativeTestJSON-227968552-project-member] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 803.176116] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGHEST for action security_group_members [ 803.176446] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.176552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.191101] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.191246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.191465] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.192338] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17e1664b-1b8f-4943-9e8b-87219c803171 with status ACTIVE [ 803.192542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.192637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.192711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.193883] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.193883] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.193883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.194257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.194257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.194257] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17e1664b-1b8f-4943-9e8b-87219c803171 is going to be updated. [ 803.220341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.220604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.220737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.220978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.221394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.221394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17e1664b-1b8f-4943-9e8b-87219c803171" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.495829] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.496770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.496770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.496770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.496770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.496955] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.497027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.497127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.497311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.497361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.497448] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9125373b-7375-4872-9f2e-c95f9102b178 is going to be updated. [ 803.528086] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.528398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.528398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.528587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.528739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.538377] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9125373b-7375-4872-9f2e-c95f9102b178 in Status: IN_PROGRESS for 2s [ 803.588030] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.588532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.588532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.588690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.588744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.588815] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 803.611137] env[65107]: INFO networking_nsxv3.common.synchronization [req-3346adc4-776b-4c85-a954-c044207f2b18 req-6972e240-3974-4bbf-af6f-b37acc563a03 tempest-ServersTestJSON-844015729 tempest-ServersTestJSON-844015729-project-member] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_members [ 803.611994] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGHEST for action security_group_members [ 803.612429] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.612586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.612692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.612933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.613166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.614469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.614469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.614469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.614469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.614469] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.625044] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.625203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.625203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.625356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.625505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.638527] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 803.698672] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.117645] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.117951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.117951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.118988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.118988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.118988] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.119406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.119512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.119676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.119753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.120033] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b is going to be updated. [ 804.157548] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.157548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.157548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.157548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.157777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.168072] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: IN_PROGRESS for 2s [ 804.201979] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.202169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.202240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.202653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.202756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.202861] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 is going to be created. [ 804.252600] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.252805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.252851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.253068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.253353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.266014] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8339c2c0-4975-4589-90b6-20ecd3100845 in Status: UNINITIALIZED for 2s [ 804.636605] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3b96b5a3-64c6-425f-b18e-90f055e7c817 None None] Enqueued Resource ID: 36f033e0-484a-4407-bb78-243b9b2456aa with Priority: HIGHEST for action port [ 804.636605] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f033e0-484a-4407-bb78-243b9b2456aa with Priority: HIGHEST for action port [ 804.636605] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-36f033e0-484a-4407-bb78-243b9b2456aa taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.636905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36f033e0-484a-4407-bb78-243b9b2456aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.636905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36f033e0-484a-4407-bb78-243b9b2456aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.637678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36f033e0-484a-4407-bb78-243b9b2456aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.637678] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36f033e0-484a-4407-bb78-243b9b2456aa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.875179] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: SUCCESS [ 804.875635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.140353] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36f033e0-484a-4407-bb78-243b9b2456aa [ 805.140353] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.140353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.140353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.140353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.140353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.140353] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36f033e0-484a-4407-bb78-243b9b2456aa already deleted. [ 805.140353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36f033e0-484a-4407-bb78-243b9b2456aa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.294921] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-10a4737a-5d2f-454c-a304-51f91b1e4e6d tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 805.295519] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 805.295863] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.295994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.296087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.296371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.296501] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.296607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.296672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.296822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.296908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.297021] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.552872] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9125373b-7375-4872-9f2e-c95f9102b178 in Status: SUCCESS [ 805.553097] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9125373b-7375-4872-9f2e-c95f9102b178 deletion is rescheduled due to dependency. [ 805.553208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.656405] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 805.656625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.656794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.657032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.662200] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.662200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.662200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.662200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.662200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.662200] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.800152] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.800355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.800591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.801009] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.804556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.804824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.804939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.805022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.805215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.805300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.805390] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 already deleted. [ 805.805467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.815134] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.815134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.815134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.815134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.815134] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.815134] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.815534] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.815859] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.815859] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.815971] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.816098] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.816344] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.816625] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.816756] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.816864] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.816996] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.836577] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.836753] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 805.836886] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.837076] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.837439] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-53d7f5cd-7976-49aa-9eaf-06386ebf4167 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.837628] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.837753] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.838080] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.838314] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53d7f5cd-7976-49aa-9eaf-06386ebf4167',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.160510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.160510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.160510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.161028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.161028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.161028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.161028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.161823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.161823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.161823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.161823] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be updated. [ 806.178863] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b in Status: SUCCESS [ 806.179115] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b deletion is rescheduled due to dependency. [ 806.179236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.198023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.198023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.198023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.198023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.198023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.213773] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: IN_PROGRESS for 2s [ 806.279933] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8339c2c0-4975-4589-90b6-20ecd3100845 in Status: SUCCESS [ 806.280101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.280288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.280539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.281380] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.281380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.281380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.281380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.281380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.281380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.281649] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.341036] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.341272] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.341442] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.341731] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.341884] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.342070] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 53d7f5cd-7976-49aa-9eaf-06386ebf4167 not found, creating... [ 806.342333] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.342497] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.342617] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.342899] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.343065] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.343455] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.343683] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.343803] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.345348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.345507] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.345661] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 53d7f5cd-7976-49aa-9eaf-06386ebf4167 is going to be created. [ 806.377944] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.378202] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.378326] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.378672] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.378824] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.379068] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.784039] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.128843] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-f6468d6d-76d4-4eed-89ca-18222603b14e service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 807.129849] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-f6468d6d-76d4-4eed-89ca-18222603b14e service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 807.130179] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-f6468d6d-76d4-4eed-89ca-18222603b14e service nova] Enqueued Resource ID: 53d7f5cd-7976-49aa-9eaf-06386ebf4167 with Priority: HIGHEST for action port [ 807.133523] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 807.133523] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 807.133523] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53d7f5cd-7976-49aa-9eaf-06386ebf4167 with Priority: HIGHEST for action port [ 807.133636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.133815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.134293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.134397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.134446] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.135850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.137155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.137155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.137155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.137155] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.137155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.137155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.138258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.138372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.138485] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.139992] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-53d7f5cd-7976-49aa-9eaf-06386ebf4167 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.142887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.142887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.142887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.142887] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53d7f5cd-7976-49aa-9eaf-06386ebf4167',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.277995] env[65107]: INFO networking_nsxv3.common.synchronization [None req-5f713f2e-d179-45e1-8a04-182994215968 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 807.279151] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 807.279677] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.279832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.279937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.280289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.280446] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.286889] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8339c2c0-4975-4589-90b6-20ecd3100845: rpc.has_security_group_logging(os_id): False [ 807.419526] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3113f96f-921a-4e9d-a4e2-6cfaee35d832 None None] Enqueued Resource ID: d47addbf-a97d-4cb3-b167-b2812d05cc2a with Priority: HIGHEST for action port [ 807.420298] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.420483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.420570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.420845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.421526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.421864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.422475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.425978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.425978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.425978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.425978] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 is going to be created. [ 807.427169] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47addbf-a97d-4cb3-b167-b2812d05cc2a with Priority: HIGHEST for action port [ 807.427940] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d47addbf-a97d-4cb3-b167-b2812d05cc2a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.427940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d47addbf-a97d-4cb3-b167-b2812d05cc2a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.427940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d47addbf-a97d-4cb3-b167-b2812d05cc2a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.428174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d47addbf-a97d-4cb3-b167-b2812d05cc2a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.428244] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d47addbf-a97d-4cb3-b167-b2812d05cc2a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.496530] env[65107]: INFO networking_nsxv3.common.synchronization [None req-80a7726e-fcc5-4178-8fb7-67a52ea3835e tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 807.498393] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 807.498393] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.498393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.516358] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.516358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.516608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.517144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.518032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.532839] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8339c2c0-4975-4589-90b6-20ecd3100845 in Status: IN_PROGRESS for 2s [ 807.645442] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.647175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.647175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.647175] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53d7f5cd-7976-49aa-9eaf-06386ebf4167 with status ACTIVE [ 807.647175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.647175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.647175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.647464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.647464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.647608] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.649655] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.649655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.649655] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53d7f5cd-7976-49aa-9eaf-06386ebf4167 is going to be updated. [ 807.678540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.678810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.678913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.679167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.679380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.679965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53d7f5cd-7976-49aa-9eaf-06386ebf4167" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.815991] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.816311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.816311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.816585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.816761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.817187] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f already deleted. [ 807.817433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.817760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.818126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.818126] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.933438] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d47addbf-a97d-4cb3-b167-b2812d05cc2a [ 807.933686] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.933858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.933947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.934242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.934439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.934439] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d47addbf-a97d-4cb3-b167-b2812d05cc2a already deleted. [ 807.934714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d47addbf-a97d-4cb3-b167-b2812d05cc2a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.151563] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.227676] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f in Status: SUCCESS [ 808.227676] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f deletion is rescheduled due to dependency. [ 808.227676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.361713] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.361713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.361713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.361713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.361713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.361713] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f already deleted. [ 808.361713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.653884] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1d11e7b6-8139-4ede-95d4-4b777ff25f43 None None] Enqueued Resource ID: 50557169-7123-41dc-b4a4-356b6b3d60bd with Priority: HIGHEST for action port [ 808.654374] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.654549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.654623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.654844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.654950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.655606] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be created. [ 808.659601] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50557169-7123-41dc-b4a4-356b6b3d60bd with Priority: HIGHEST for action port [ 808.659845] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-50557169-7123-41dc-b4a4-356b6b3d60bd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.659980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50557169-7123-41dc-b4a4-356b6b3d60bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.660070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50557169-7123-41dc-b4a4-356b6b3d60bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.660365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50557169-7123-41dc-b4a4-356b6b3d60bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.660488] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50557169-7123-41dc-b4a4-356b6b3d60bd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.688986] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.689233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.689233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.689413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.689568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.701676] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: UNINITIALIZED for 2s [ 809.164462] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50557169-7123-41dc-b4a4-356b6b3d60bd [ 809.164462] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.164649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.164649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.165901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.165901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.165901] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50557169-7123-41dc-b4a4-356b6b3d60bd already deleted. [ 809.165901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50557169-7123-41dc-b4a4-356b6b3d60bd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.546850] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8339c2c0-4975-4589-90b6-20ecd3100845 in Status: SUCCESS [ 809.547188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.712092] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 810.712678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.712678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.714318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.714318] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.714318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.714318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.714318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.714318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.714318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.714318] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.100870] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0954f42b-3459-47c7-8c16-f31ceef25c11 tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 811.105280] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 811.105280] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.105280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.105280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.105280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.105280] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.219049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.219049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.219049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.219049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.219049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.219679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.219679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.219679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.219679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.219679] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.269599] env[65107]: INFO networking_nsxv3.common.synchronization [None req-701365ae-0170-4c62-9cc6-40b8ab2cebf1 tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 811.270627] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 811.272755] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.272755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.626687] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.627140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.627140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.627140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.627429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.627429] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d already deleted. [ 811.627429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.627586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.627702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.627761] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.723049] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3c6061-32c5-4c10-8da4-b1be3cb71a03: rpc.has_security_group_logging(os_id): False [ 811.744882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.744882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.744882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.745128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.745128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.745341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.745448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.745512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.745684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.745761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.745943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.746068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.746132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.746282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.746357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.747405] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.747575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.747657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.747871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.747974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.748096] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be created. [ 811.825431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.825609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.825609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.825778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.825968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.840385] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 812.150606] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.151598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.151717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.151956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.152051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.152153] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d already deleted. [ 812.152345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.496614] env[65107]: INFO networking_nsxv3.common.synchronization [None req-fbd64340-34c8-4dd0-b8df-4d84db326f95 None None] Enqueued Resource ID: dc85dc23-3c39-4790-8631-9e05285190de with Priority: HIGHEST for action port [ 812.497306] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc85dc23-3c39-4790-8631-9e05285190de with Priority: HIGHEST for action port [ 812.497707] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc85dc23-3c39-4790-8631-9e05285190de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.497978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc85dc23-3c39-4790-8631-9e05285190de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.498110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc85dc23-3c39-4790-8631-9e05285190de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.498544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc85dc23-3c39-4790-8631-9e05285190de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.498780] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc85dc23-3c39-4790-8631-9e05285190de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.001902] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc85dc23-3c39-4790-8631-9e05285190de [ 813.002447] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.002447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.002678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.002735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.002924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.003033] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc85dc23-3c39-4790-8631-9e05285190de already deleted. [ 813.003155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc85dc23-3c39-4790-8631-9e05285190de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.860954] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 813.861599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.895188] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-58d0df2a-0061-4746-a810-b2449d0300b7 tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 813.895766] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 813.896728] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.896872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.897935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.898130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.898317] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.898432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.898495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.898678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.899173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.899173] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.282390] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.282666] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.282782] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.287776] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.287776] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.287776] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.287776] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.288421] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.289051] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.289051] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.289280] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.289491] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.290981] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.290981] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.290981] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.290981] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.318836] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.318972] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.319125] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.319361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.319622] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-277894f9-0b12-419b-a826-b50601a5f47f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.319798] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.319918] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.320308] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.320621] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('277894f9-0b12-419b-a826-b50601a5f47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.403167] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.830601] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.831306] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.831622] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.831928] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.832113] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.832274] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 277894f9-0b12-419b-a826-b50601a5f47f not found, creating... [ 814.832542] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.832855] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.832985] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.833249] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.833407] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.833748] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.833911] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.834137] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.834298] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.834600] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.834600] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 277894f9-0b12-419b-a826-b50601a5f47f is going to be created. [ 814.859107] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.859620] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.859620] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.859948] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.860259] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.860633] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.904565] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.409982] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.410692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.410692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.410692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.410692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.410692] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 815.461785] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.461785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.461785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.461785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.461785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.474258] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 815.629127] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-8344fe02-5dff-48aa-af8f-e740dcca6be6 service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 815.629332] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-8344fe02-5dff-48aa-af8f-e740dcca6be6 service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 815.629468] env[65107]: INFO networking_nsxv3.common.synchronization [req-93fd32f3-87a0-4769-830a-773b00b8eb1c req-8344fe02-5dff-48aa-af8f-e740dcca6be6 service nova] Enqueued Resource ID: 277894f9-0b12-419b-a826-b50601a5f47f with Priority: HIGHEST for action port [ 815.630065] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 815.630220] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 815.630319] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 277894f9-0b12-419b-a826-b50601a5f47f with Priority: HIGHEST for action port [ 815.631159] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.631255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.631312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.631564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.631646] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.632778] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.632839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.633073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-277894f9-0b12-419b-a826-b50601a5f47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.633181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.633254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.633433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.633511] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('277894f9-0b12-419b-a826-b50601a5f47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.040100] env[65107]: INFO networking_nsxv3.common.synchronization [req-5334f343-0b30-4aba-b815-f273add2e7b5 req-049f9bf6-6971-4c16-b61f-a9e8ad33fe6a tempest-FloatingIPsAssociationTestJSON-90781303 tempest-FloatingIPsAssociationTestJSON-90781303-project-member] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 816.040900] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGHEST for action security_group_members [ 816.041238] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.041362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.041442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.041631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.041786] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.041885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.041948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.042108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.042193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.042289] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.138556] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 277894f9-0b12-419b-a826-b50601a5f47f with status ACTIVE [ 816.141129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.141296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.141364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.141621] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.141720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.141938] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.142055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.142135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.142312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.142406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.142620] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.142720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.142899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.143049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.143113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.143214] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 277894f9-0b12-419b-a826-b50601a5f47f is going to be updated. [ 816.146377] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.146377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.169237] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.169237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.169237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.169237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.169528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.169528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-277894f9-0b12-419b-a826-b50601a5f47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.544766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.545127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.545127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.548305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.548305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.548305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.548305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.548305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.548305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.548305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.548305] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be updated. [ 816.579370] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.579370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.579370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.579370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.579370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.590095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: IN_PROGRESS for 2s [ 817.484744] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 817.485166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.485529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.485947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.486343] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.486658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.486803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.487075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.487852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.487985] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.990738] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.493897] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.603510] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6801a112-5684-487c-b713-b3fc340c09d5 in Status: SUCCESS [ 818.603739] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 deletion is rescheduled due to dependency. [ 818.603909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.997060] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.997797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.997797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.997797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.997797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.997797] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 819.026783] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.027022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.027078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.028979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.028979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.038704] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 819.132032] env[65107]: INFO networking_nsxv3.common.synchronization [req-ab586001-6dec-440c-bf1f-6f285441b106 req-1480b7e6-edf3-484c-bde0-57ff68bc6d05 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 819.134008] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 819.136258] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.136258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.136258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.136258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.136514] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.136577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.136705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.138597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.138597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.138597] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.606343] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.606343] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.606343] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.606817] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.606896] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.607375] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.607430] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.607643] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.607840] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.607991] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.608116] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.608221] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.608323] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.608427] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.608526] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.608655] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.633102] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.633102] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.633102] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.633102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.633434] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-23cd3340-7a64-4799-bf93-97627592f06b taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.633579] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.633642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.636464] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.636464] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23cd3340-7a64-4799-bf93-97627592f06b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.641768] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.641962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.642046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.642261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.642383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.642574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.642642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.642702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.642997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.643087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.643796] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be already deleted. [ 819.643796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.137376] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.137708] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.137755] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.138898] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.138898] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.138898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 23cd3340-7a64-4799-bf93-97627592f06b not found, creating... [ 820.138898] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.138898] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.139137] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.139430] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.139726] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.140090] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.140292] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.140745] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.141116] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.141185] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.142037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 23cd3340-7a64-4799-bf93-97627592f06b is going to be created. [ 820.166746] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.167079] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.167221] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.167538] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.167845] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.168158] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.914541] env[65107]: INFO networking_nsxv3.common.synchronization [req-ab586001-6dec-440c-bf1f-6f285441b106 req-a8392ed9-9c54-4ffa-aee1-de297e8c0e30 service nova] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 820.914541] env[65107]: INFO networking_nsxv3.common.synchronization [req-ab586001-6dec-440c-bf1f-6f285441b106 req-a8392ed9-9c54-4ffa-aee1-de297e8c0e30 service nova] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 820.914541] env[65107]: INFO networking_nsxv3.common.synchronization [req-ab586001-6dec-440c-bf1f-6f285441b106 req-a8392ed9-9c54-4ffa-aee1-de297e8c0e30 service nova] Enqueued Resource ID: 23cd3340-7a64-4799-bf93-97627592f06b with Priority: HIGHEST for action port [ 820.914541] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 820.914541] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 820.915876] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23cd3340-7a64-4799-bf93-97627592f06b with Priority: HIGHEST for action port [ 820.916077] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.916820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.917206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.917618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.918071] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.920802] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.921190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.921416] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.921751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.922145] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.926035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.926035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.926035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.926035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.926035] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.926035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-23cd3340-7a64-4799-bf93-97627592f06b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.926035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.926035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.926035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.926035] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23cd3340-7a64-4799-bf93-97627592f06b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.052117] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 821.052117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.052117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.052117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.052515] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.052603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.052726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.052921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.053078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.053238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.053492] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.426973] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.427296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.427423] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.428354] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23cd3340-7a64-4799-bf93-97627592f06b with status ACTIVE [ 821.428588] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.428725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.428809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.429089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.429127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.429831] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.429831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.429831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.429831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.429831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.429992] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.429992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.431268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.432530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.432530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.432530] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23cd3340-7a64-4799-bf93-97627592f06b is going to be updated. [ 821.467866] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.467866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.467866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.467866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.468239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.468337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23cd3340-7a64-4799-bf93-97627592f06b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.555722] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.555958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.556046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.556258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.556920] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.556920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.556920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.556920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.556920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.556920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.557269] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.557269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.557269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.557375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.557539] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.557539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.557632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.557699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.557860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.557860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.557954] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.936818] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.062168] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3c6061-32c5-4c10-8da4-b1be3cb71a03: rpc.has_security_group_logging(os_id): False [ 822.081924] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.082439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.083181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.083181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.083181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.083308] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.083464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.083627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.083820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.083934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.084184] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.084322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.084413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.084609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.084718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.084928] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.085065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.085133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.085514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.085661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.085741] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 822.107034] env[65107]: INFO networking_nsxv3.common.synchronization [None req-3533cdaa-6fc8-4d27-8813-26fa5c3c91bb None None] Enqueued Resource ID: 95b08f0b-add5-4748-93dc-c5f21061b887 with Priority: HIGHEST for action port [ 822.107034] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b08f0b-add5-4748-93dc-c5f21061b887 with Priority: HIGHEST for action port [ 822.108177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b08f0b-add5-4748-93dc-c5f21061b887 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.109797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b08f0b-add5-4748-93dc-c5f21061b887" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.109797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b08f0b-add5-4748-93dc-c5f21061b887" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.109797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b08f0b-add5-4748-93dc-c5f21061b887" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.109797] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b08f0b-add5-4748-93dc-c5f21061b887',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.163797] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.163797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.163797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.163797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.163797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.176937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 822.438573] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.438962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.438962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.439071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.439114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.439211] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be is going to be created. [ 822.469230] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.469383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.469457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.469659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.469820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.483351] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: UNINITIALIZED for 2s [ 822.612052] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95b08f0b-add5-4748-93dc-c5f21061b887 [ 822.612307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.612516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.612516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.612756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.612853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.612955] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95b08f0b-add5-4748-93dc-c5f21061b887 already deleted. [ 822.613048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b08f0b-add5-4748-93dc-c5f21061b887" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.666258] env[65107]: INFO networking_nsxv3.common.synchronization [None req-c477f305-235b-4e11-8e47-da438d9b08bc tempest-ServersTestManualDisk-1947433380 tempest-ServersTestManualDisk-1947433380-project-member] Enqueued Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_rules [ 822.667151] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_rules [ 822.667485] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.667583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.667667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.669397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.669397] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.775304] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1ae318a3-6444-4942-ae9f-297da2ef3aa8 tempest-ServersTestManualDisk-1947433380 tempest-ServersTestManualDisk-1947433380-project-member] Enqueued Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_rules [ 822.775304] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_rules [ 822.775598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.776033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.192546] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.192728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.192832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.193053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.193157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.193332] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de already deleted. [ 823.193332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.193531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.193732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.193732] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.496471] env[65107]: INFO networking_nsxv3.common.synchronization [None req-adc24284-e6a7-4888-a159-bb420fbb4161 tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_rules [ 823.496802] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_rules [ 823.497179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.497318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.497617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.497899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.498009] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.612720] env[65107]: INFO networking_nsxv3.common.synchronization [None req-a464e681-7197-47f5-bd4f-9eb5a2e926ac tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_rules [ 823.613277] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_rules [ 823.615158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.615306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.716603] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.716699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.716755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.716981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.717096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.717192] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de already deleted. [ 823.717276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.025986] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.025986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.025986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.025986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.025986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.025986] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 already deleted. [ 824.025986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.025986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.025986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.026440] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.192028] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 824.193702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.496268] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: SUCCESS [ 824.496519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.496862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.497186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.497186] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.497341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.497408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.497714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.497714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.497919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.497997] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.552542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.552741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.552813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.553022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.553084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.553184] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 already deleted. [ 824.553303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.761230] env[65107]: INFO networking_nsxv3.common.synchronization [None req-298a5b00-0aed-4271-9a6e-1bfcd57528bc None None] Enqueued Resource ID: 7e0b573c-20d6-4c22-8ae7-452eb0dc1f23 with Priority: HIGHEST for action port [ 824.763902] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b573c-20d6-4c22-8ae7-452eb0dc1f23 with Priority: HIGHEST for action port [ 824.764311] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e0b573c-20d6-4c22-8ae7-452eb0dc1f23 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.764468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e0b573c-20d6-4c22-8ae7-452eb0dc1f23" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.764509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e0b573c-20d6-4c22-8ae7-452eb0dc1f23" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.764762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e0b573c-20d6-4c22-8ae7-452eb0dc1f23" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.764868] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0b573c-20d6-4c22-8ae7-452eb0dc1f23',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.002550] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.270814] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e0b573c-20d6-4c22-8ae7-452eb0dc1f23 [ 825.271534] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.271534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.271750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.271923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.272212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.274393] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e0b573c-20d6-4c22-8ae7-452eb0dc1f23 already deleted. [ 825.274393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e0b573c-20d6-4c22-8ae7-452eb0dc1f23" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.505858] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d4a7699-28a9-417a-9e0b-bf15ce0027be: rpc.has_security_group_logging(os_id): False [ 825.535136] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.535331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.535401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.535658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.535979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.537024] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.537024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.537024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.537024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.537024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.537024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be is going to be created. [ 825.603233] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.607136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.607136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.607136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.607136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.626354] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: IN_PROGRESS for 2s [ 826.559674] env[65107]: INFO networking_nsxv3.common.synchronization [req-abea3f57-7fb4-4278-9497-d12783ca0ce4 req-b28324ce-3c98-44ef-9f26-ac73e5641237 tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 826.561462] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 826.561680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.561850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.561943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.562175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.562434] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.562630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.562711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.562885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.562977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.563107] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.066116] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.568539] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.640252] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: SUCCESS [ 827.640566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.972055] env[65107]: INFO networking_nsxv3.common.synchronization [req-f04e59f1-5860-493d-99ad-811b8e06728b req-39811644-db7c-4090-b8c1-30f9749d6829 tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 827.972585] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 827.973052] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.973282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.973373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.973581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.973747] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.974057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.974156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.974437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.974531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.974628] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.073343] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.073343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.073573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.073645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.073866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.073866] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 828.107344] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.107688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.107842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.108155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.108397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.122069] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 828.192566] env[65107]: INFO networking_nsxv3.common.synchronization [req-fcff8926-364d-48c5-aadd-572252c90834 req-58c78676-d0ff-4a79-80f1-d6b83401ee06 tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 828.193129] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 828.193452] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.193786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.477890] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.649378] env[65107]: INFO networking_nsxv3.common.synchronization [req-5ce9017e-102e-4319-97f1-2ead54209a0d req-f91bff53-c929-4805-9f49-557178f42301 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 828.649378] env[65107]: INFO networking_nsxv3.common.synchronization [req-5ce9017e-102e-4319-97f1-2ead54209a0d req-f91bff53-c929-4805-9f49-557178f42301 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 828.649378] env[65107]: INFO networking_nsxv3.common.synchronization [req-5ce9017e-102e-4319-97f1-2ead54209a0d req-f91bff53-c929-4805-9f49-557178f42301 tempest-SecurityGroupsTestJSON-1545660035 tempest-SecurityGroupsTestJSON-1545660035-project-member] Enqueued Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_members [ 828.654035] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 with Priority: HIGHEST for action security_group_members [ 828.654035] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGHEST for action security_group_members [ 828.654035] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGHEST for action security_group_members [ 828.654035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.654035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.654035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.654035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.654035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.654035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.654035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.654035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.654035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.654035] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.654716] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.654716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.654716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.654716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.654918] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.654918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.654998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.655485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.655485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.655485] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.656167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-f472a668-4442-488d-936d-2a700ed0a421 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.656276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.656336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.656839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.656839] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.656839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.656839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.657066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.657066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.657066] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.980823] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.160668] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.160668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.160668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.160668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.160668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.160668] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.160668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.160982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.160982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.160982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.161107] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be updated. [ 829.162427] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.162583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.162652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.162806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.163878] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.164033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.188726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.189886] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.189886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.189886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.189886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.189886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.189886] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f472a668-4442-488d-936d-2a700ed0a421 is going to be updated. [ 829.190578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.191978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.191978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.191978] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.191978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.191978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.191978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.191978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.191978] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 is going to be updated. [ 829.207634] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.207844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.207992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.208240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.208389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.216494] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: IN_PROGRESS for 2s [ 829.224298] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.224298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.224448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.224567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.225315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.226469] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.226575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.226637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.226943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.226943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.236936] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: IN_PROGRESS for 2s [ 829.240094] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: IN_PROGRESS for 2s [ 829.483020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.483218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.483290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.483513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.483616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.483962] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 829.521703] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.521979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.522085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.522308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.522471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.534410] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 830.131290] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 830.131600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.226779] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 in Status: SUCCESS [ 831.227077] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 deletion is rescheduled due to dependency. [ 831.227143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.246682] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f472a668-4442-488d-936d-2a700ed0a421 in Status: SUCCESS [ 831.246866] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f472a668-4442-488d-936d-2a700ed0a421 deletion is rescheduled due to dependency. [ 831.247045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.249289] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 in Status: SUCCESS [ 831.249289] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8 deletion is rescheduled due to dependency. [ 831.249289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.546947] env[65107]: INFO networking_nsxv3.common.synchronization [req-427e69a6-e642-46f2-9b23-35ea0ba98cd2 req-7e476afe-a4ac-49a4-9578-5b681b2e98d8 tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 831.548248] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 831.548248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.548248] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 831.548248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.548248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.548675] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.548675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.548675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.548897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.548897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.548970] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.549889] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.550009] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.550077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.550233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.550880] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.550880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.550880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.550880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.550880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.550880] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.890019] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.890019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.890019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.890019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.890019] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.890019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.890019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.890019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.890019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.890470] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.890470] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.890470] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.890470] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.890630] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.890663] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.890884] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.912699] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.912870] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.913020] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.913391] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.913727] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-d0ea9751-beda-41c9-bb30-438bd846fe37 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.914060] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.914060] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.914387] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.914522] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0ea9751-beda-41c9-bb30-438bd846fe37',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.052522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.052679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.052744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.052969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.053109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.053357] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.053431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.053472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.055024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.055024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.055024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 832.055024] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.055267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.055267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.055369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.055414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.055579] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.055671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.055730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.055867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.055954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.056206] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 832.081605] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.081789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.081847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.082061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.082204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.083999] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.084138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.084188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.084347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.084458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.094744] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 832.095574] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 832.417510] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417897] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.418419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.418781] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.419150] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.419150] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port d0ea9751-beda-41c9-bb30-438bd846fe37 not found, creating... [ 832.419497] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.420018] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.420018] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.420330] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.420487] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.420904] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.421165] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.421278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.421452] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.421550] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.421684] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: d0ea9751-beda-41c9-bb30-438bd846fe37 is going to be created. [ 832.444908] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.445185] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.445185] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.445455] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.445678] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.445902] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.154912] env[65107]: INFO networking_nsxv3.common.synchronization [req-427e69a6-e642-46f2-9b23-35ea0ba98cd2 req-d5ffd127-6ee2-46c0-ac2f-a76844fa8767 service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 833.154912] env[65107]: INFO networking_nsxv3.common.synchronization [req-427e69a6-e642-46f2-9b23-35ea0ba98cd2 req-d5ffd127-6ee2-46c0-ac2f-a76844fa8767 service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 833.154912] env[65107]: INFO networking_nsxv3.common.synchronization [req-427e69a6-e642-46f2-9b23-35ea0ba98cd2 req-d5ffd127-6ee2-46c0-ac2f-a76844fa8767 service nova] Enqueued Resource ID: d0ea9751-beda-41c9-bb30-438bd846fe37 with Priority: HIGHEST for action port [ 833.154912] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 833.154912] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 833.154912] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ea9751-beda-41c9-bb30-438bd846fe37 with Priority: HIGHEST for action port [ 833.155159] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.155212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.155251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.155439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.155546] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.157033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.157033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.157239] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0ea9751-beda-41c9-bb30-438bd846fe37 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.157239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.157239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.157385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.157426] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0ea9751-beda-41c9-bb30-438bd846fe37',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.657345] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.657345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.660220] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0ea9751-beda-41c9-bb30-438bd846fe37 with status ACTIVE [ 833.660220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.660220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.660395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.660503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.660608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.661433] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.661433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.661433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.661433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.661433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.661433] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.661923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.661923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.661923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.661923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.661923] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0ea9751-beda-41c9-bb30-438bd846fe37 is going to be updated. [ 833.687875] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.689126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.689943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.689943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.689943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.689943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0ea9751-beda-41c9-bb30-438bd846fe37" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.107018] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 834.108086] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 834.108086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.108086] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 834.108207] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 deletion is rescheduled due to dependency. [ 834.108310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.108462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.108666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.108876] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.108960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.109057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.109663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.109663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.109663] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.612410] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.785077] env[65107]: INFO networking_nsxv3.common.synchronization [req-8da4a01b-69e5-4c5d-8e11-5b97f103de9a req-90e6077d-a07b-460a-a119-267986c502dd tempest-VolumesAssistedSnapshotsTest-73147858 tempest-VolumesAssistedSnapshotsTest-73147858-project-member] Enqueued Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_members [ 834.785635] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560f9d77-f914-4f8b-bc22-1688e970b817 with Priority: HIGHEST for action security_group_members [ 834.785950] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-560f9d77-f914-4f8b-bc22-1688e970b817 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.788157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.788245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.788448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.788629] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.788765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.788836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.788999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.789102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.789200] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('560f9d77-f914-4f8b-bc22-1688e970b817',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.117866] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.293627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.293779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.293874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.294121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.317184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.317184] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.317184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.317184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.317184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.317184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.317184] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 560f9d77-f914-4f8b-bc22-1688e970b817 is going to be updated. [ 835.345581] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.346293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.346293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.346293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.346293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.355897] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 560f9d77-f914-4f8b-bc22-1688e970b817 in Status: IN_PROGRESS for 2s [ 835.620458] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.620458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.620458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.621279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.621279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.621279] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 835.681687] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.681977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.681977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.682106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.682212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.691172] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 837.367368] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 560f9d77-f914-4f8b-bc22-1688e970b817 in Status: SUCCESS [ 837.367846] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 560f9d77-f914-4f8b-bc22-1688e970b817 deletion is rescheduled due to dependency. [ 837.367846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-560f9d77-f914-4f8b-bc22-1688e970b817" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.702721] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 837.702721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.702721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.702721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.702721] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.703632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.703632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.703632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.703747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.703784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.703877] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.066955] env[65107]: INFO networking_nsxv3.common.synchronization [req-4a6c091b-5ce3-4901-970e-ed308c818f5f req-66c21e96-7202-488f-98cc-2a319ad2bb71 tempest-ListImageFiltersTestJSON-1797771645 tempest-ListImageFiltersTestJSON-1797771645-project-member] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 838.067571] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGHEST for action security_group_members [ 838.067812] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.067935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.068008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.068217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.068370] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.068475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.068539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.068684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.068770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.068869] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.206158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.206321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.206407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.206625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.206837] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.206949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.207028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.207198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.207274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.207382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.207501] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.207589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.207641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.207776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.207943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.208088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.208088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.208231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.208302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.208379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.208467] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.571251] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.571609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.571609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.571782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.595304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.595569] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.595700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.595760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.595959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.596115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.596161] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be updated. [ 838.627496] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.627661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.627725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.628015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.628169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.638079] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: IN_PROGRESS for 2s [ 838.711579] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6970c294-30ba-4814-9be8-ff7a47ecd5e8: rpc.has_security_group_logging(os_id): False [ 838.735360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.735360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.735360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.735360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.735989] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.735989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.735989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.735989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.735989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.736583] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 838.798702] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.798702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.798702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.798948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.798948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.812526] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 840.650313] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed87eef5-439b-4752-b6cf-ead13a28e49a in Status: SUCCESS [ 840.650643] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a deletion is rescheduled due to dependency. [ 840.650643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.858349] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 840.858600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.068821] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 843.069129] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 846.464827] env[65107]: INFO networking_nsxv3.common.synchronization [None req-441b5586-95f5-45e9-a518-c74c5e1f116e None None] Enqueued Resource ID: 58e9e0dd-ce06-4025-a68b-273a61ab7e75 with Priority: HIGHEST for action port [ 846.465861] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58e9e0dd-ce06-4025-a68b-273a61ab7e75 with Priority: HIGHEST for action port [ 846.466469] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-58e9e0dd-ce06-4025-a68b-273a61ab7e75 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.466857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58e9e0dd-ce06-4025-a68b-273a61ab7e75" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.466857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58e9e0dd-ce06-4025-a68b-273a61ab7e75" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.467547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58e9e0dd-ce06-4025-a68b-273a61ab7e75" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.467547] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58e9e0dd-ce06-4025-a68b-273a61ab7e75',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.970616] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58e9e0dd-ce06-4025-a68b-273a61ab7e75 [ 846.970890] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.971145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.971586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.971586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.971586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.971695] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58e9e0dd-ce06-4025-a68b-273a61ab7e75 already deleted. [ 846.971695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58e9e0dd-ce06-4025-a68b-273a61ab7e75" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.464859] env[65107]: INFO networking_nsxv3.common.synchronization [req-bedc1767-4afd-4394-aca8-c5f378bca452 req-9868c823-c7c6-4d0a-808a-31f31a94bf5c tempest-ServersNegativeTestJSON-35009868 tempest-ServersNegativeTestJSON-35009868-project-member] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 848.464859] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 848.464859] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.464859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.464859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.464859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.465391] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.465391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.465391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.465391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.465391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.465590] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.823241] env[65107]: INFO networking_nsxv3.common.synchronization [None req-5ab710eb-3cdf-4c59-b6fd-ac225d7df1ee None None] Enqueued Resource ID: 7be4469f-c1a9-4f84-bda5-44bef169ecc5 with Priority: HIGHEST for action port [ 848.824145] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be4469f-c1a9-4f84-bda5-44bef169ecc5 with Priority: HIGHEST for action port [ 848.824661] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7be4469f-c1a9-4f84-bda5-44bef169ecc5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.824661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7be4469f-c1a9-4f84-bda5-44bef169ecc5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.824865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7be4469f-c1a9-4f84-bda5-44bef169ecc5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.825229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7be4469f-c1a9-4f84-bda5-44bef169ecc5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.825314] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7be4469f-c1a9-4f84-bda5-44bef169ecc5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.853401] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-352 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.853627] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.853757] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.854099] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.854438] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.854619] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.854699] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.854907] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.855297] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.856033] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.856033] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.856033] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.856033] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.856033] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.857253] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.857253] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.881033] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.881293] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.881426] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.881645] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.881913] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.882799] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.882799] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.882799] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.882799] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea008238-00e3-46a1-8b40-1c1a5ef3fafa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.969228] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.329441] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7be4469f-c1a9-4f84-bda5-44bef169ecc5 [ 849.329702] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.329843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.329912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.330175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.330289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.330388] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7be4469f-c1a9-4f84-bda5-44bef169ecc5 already deleted. [ 849.330469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7be4469f-c1a9-4f84-bda5-44bef169ecc5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.385705] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386172] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.387506] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.387506] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.387506] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port ea008238-00e3-46a1-8b40-1c1a5ef3fafa not found, creating... [ 849.387506] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.387506] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.387506] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.388022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.388022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.388807] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.388807] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.388807] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.389364] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.389364] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.389364] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: ea008238-00e3-46a1-8b40-1c1a5ef3fafa is going to be created. [ 849.412025] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.412220] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.412343] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.412624] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.412895] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.413694] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.470689] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.695175] env[65107]: INFO networking_nsxv3.common.synchronization [None req-ff5cef2c-510c-4800-90bf-58b5c1f2e12e None None] Enqueued Resource ID: 81c34a6e-7d51-44cd-93f5-d9675bca39e3 with Priority: HIGHEST for action port [ 849.695955] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c34a6e-7d51-44cd-93f5-d9675bca39e3 with Priority: HIGHEST for action port [ 849.698221] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-81c34a6e-7d51-44cd-93f5-d9675bca39e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.698221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81c34a6e-7d51-44cd-93f5-d9675bca39e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.698221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81c34a6e-7d51-44cd-93f5-d9675bca39e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.698221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81c34a6e-7d51-44cd-93f5-d9675bca39e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.698221] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81c34a6e-7d51-44cd-93f5-d9675bca39e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.975314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.975521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.975521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.975765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.975834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.975895] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be updated. [ 850.011834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.011834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.011834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.011834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.011834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.023531] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 850.080912] env[65107]: INFO networking_nsxv3.common.synchronization [req-c9cba264-efdd-4393-9cbc-ebf51ab14fc8 req-7222f145-000a-4879-9b4a-cd0ce3032a77 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 850.082031] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 850.082882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.083073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.083134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.083502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.084194] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.084363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.084486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.084572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.084651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.084748] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.164200] env[65107]: INFO networking_nsxv3.common.synchronization [req-bedc1767-4afd-4394-aca8-c5f378bca452 req-d5e4a7fc-46bd-4491-b4e3-1b62916f65e5 service nova] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_rules [ 850.164200] env[65107]: INFO networking_nsxv3.common.synchronization [req-bedc1767-4afd-4394-aca8-c5f378bca452 req-d5e4a7fc-46bd-4491-b4e3-1b62916f65e5 service nova] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 850.164200] env[65107]: INFO networking_nsxv3.common.synchronization [req-bedc1767-4afd-4394-aca8-c5f378bca452 req-d5e4a7fc-46bd-4491-b4e3-1b62916f65e5 service nova] Enqueued Resource ID: ea008238-00e3-46a1-8b40-1c1a5ef3fafa with Priority: HIGHEST for action port [ 850.164200] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_rules [ 850.164200] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 850.164200] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea008238-00e3-46a1-8b40-1c1a5ef3fafa with Priority: HIGHEST for action port [ 850.166941] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.168058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.168058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.168058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.168058] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.171585] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.171702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.171942] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.172078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.172164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.172705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.172705] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea008238-00e3-46a1-8b40-1c1a5ef3fafa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.201886] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81c34a6e-7d51-44cd-93f5-d9675bca39e3 [ 850.202015] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.202158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.202325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.202676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.202774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.202823] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81c34a6e-7d51-44cd-93f5-d9675bca39e3 already deleted. [ 850.203115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81c34a6e-7d51-44cd-93f5-d9675bca39e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.412032] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.412032] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.412032] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.412032] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.412443] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.412653] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.412780] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.413037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.413214] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.413494] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.413692] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.413851] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.414011] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.414812] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.414812] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.414812] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.442019] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.442303] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.442303] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.442443] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.443204] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-b72290f3-e326-4fe3-af57-1a3a2abcaa80 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.443959] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.443959] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.444135] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.444135] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72290f3-e326-4fe3-af57-1a3a2abcaa80',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.588129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.588129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.588129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.588129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.588129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.588129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.588731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.588731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.588731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.588731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.588731] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed already deleted. [ 850.588731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.674711] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.674858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.675067] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea008238-00e3-46a1-8b40-1c1a5ef3fafa with status ACTIVE [ 850.675242] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.675349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.675415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.675636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.676719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.676719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.676719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.676719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.676719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.676719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.676719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.676719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.676719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.677493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.677493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.677493] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea008238-00e3-46a1-8b40-1c1a5ef3fafa is going to be updated. [ 850.702029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.702029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.702029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.702029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.702029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.702029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea008238-00e3-46a1-8b40-1c1a5ef3fafa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.947930] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.948169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.948259] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.948595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.948753] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.949067] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port b72290f3-e326-4fe3-af57-1a3a2abcaa80 not found, creating... [ 850.949418] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.949967] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.949967] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.949967] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.950148] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.950400] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.950543] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.950661] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.950877] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.951157] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.951322] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: b72290f3-e326-4fe3-af57-1a3a2abcaa80 is going to be created. [ 850.975505] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.975815] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.978805] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.978805] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.978805] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.978805] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.279899] env[65107]: INFO networking_nsxv3.common.synchronization [None req-c40499eb-d1f8-4aa0-b2dd-389c6319272f None None] Enqueued Resource ID: e3aab999-c584-40ab-a798-744380865a00 with Priority: HIGHEST for action port [ 851.280441] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3aab999-c584-40ab-a798-744380865a00 with Priority: HIGHEST for action port [ 851.280759] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3aab999-c584-40ab-a798-744380865a00 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.280880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3aab999-c584-40ab-a798-744380865a00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.281059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3aab999-c584-40ab-a798-744380865a00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.281326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3aab999-c584-40ab-a798-744380865a00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.281326] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3aab999-c584-40ab-a798-744380865a00',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.302212] env[65107]: INFO networking_nsxv3.common.synchronization [req-6dc4ae1f-00d7-4ed8-b7e0-ac213cb84e0a req-c2a78881-0949-4f1f-9a37-00253416dde5 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 851.302647] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 851.303197] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.303331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.303411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.303667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.303891] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.304363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.304363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.304475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.304617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.304752] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.682574] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.682934] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.682934] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.683310] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.683616] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.683849] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.683944] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.685340] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.685501] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.685708] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.685815] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.685917] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.686030] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.686134] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.686233] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.686379] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.696400] env[65107]: INFO networking_nsxv3.common.synchronization [req-c9cba264-efdd-4393-9cbc-ebf51ab14fc8 req-e664d4ba-9cc6-4a4c-99c3-138754d72917 service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 851.696605] env[65107]: INFO networking_nsxv3.common.synchronization [req-c9cba264-efdd-4393-9cbc-ebf51ab14fc8 req-e664d4ba-9cc6-4a4c-99c3-138754d72917 service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 851.696828] env[65107]: INFO networking_nsxv3.common.synchronization [req-c9cba264-efdd-4393-9cbc-ebf51ab14fc8 req-e664d4ba-9cc6-4a4c-99c3-138754d72917 service nova] Enqueued Resource ID: b72290f3-e326-4fe3-af57-1a3a2abcaa80 with Priority: HIGHEST for action port [ 851.698189] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 851.698189] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 851.698189] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72290f3-e326-4fe3-af57-1a3a2abcaa80 with Priority: HIGHEST for action port [ 851.698612] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.698732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.698800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.699051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.699184] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.699974] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.700097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.700255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.700392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.700628] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.700697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.700763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.700909] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.701054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.702240] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.704187] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72290f3-e326-4fe3-af57-1a3a2abcaa80 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.704187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.704187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.704187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.704187] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72290f3-e326-4fe3-af57-1a3a2abcaa80',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.716510] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.717071] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.717071] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.717241] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.718031] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-792c3fd1-9eab-4d0c-812e-5ddaa132069a taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.718321] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.718511] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.719372] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.719372] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792c3fd1-9eab-4d0c-812e-5ddaa132069a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.785559] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3aab999-c584-40ab-a798-744380865a00 [ 851.786480] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.786480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.786480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.786480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.786480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.786480] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3aab999-c584-40ab-a798-744380865a00 already deleted. [ 851.786480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3aab999-c584-40ab-a798-744380865a00" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.807023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.807208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.807283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.808407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.808407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.808407] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.808407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.808407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.808407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.808407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.808407] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f already deleted. [ 851.808407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.033454] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 852.033691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.034273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.034273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.034273] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.034581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.034581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.034581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.034693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.034747] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.205976] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.206998] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.207131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.208615] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b72290f3-e326-4fe3-af57-1a3a2abcaa80 with status ACTIVE [ 852.209467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.209467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.209467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.209467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.209467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.209467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.209807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.209807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.209807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.209807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.209933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.210116] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.210236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.210430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.210511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.210600] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b72290f3-e326-4fe3-af57-1a3a2abcaa80 is going to be updated. [ 852.222935] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.222935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.222935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.222935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.222935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.222935] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 792c3fd1-9eab-4d0c-812e-5ddaa132069a not found, creating... [ 852.223296] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.223296] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.223398] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.223557] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.223684] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.223954] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.224119] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.224229] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.224420] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.224543] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.224675] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 792c3fd1-9eab-4d0c-812e-5ddaa132069a is going to be created. [ 852.235291] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.235376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.235455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.235643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.235781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.235943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72290f3-e326-4fe3-af57-1a3a2abcaa80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.245521] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.245746] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.245867] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.246167] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.246391] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.246616] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.537131] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.708033] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.944511] env[65107]: INFO networking_nsxv3.common.synchronization [req-6dc4ae1f-00d7-4ed8-b7e0-ac213cb84e0a req-61034c56-8178-476c-ae01-bcf43f4abd3d service nova] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 852.944702] env[65107]: INFO networking_nsxv3.common.synchronization [req-6dc4ae1f-00d7-4ed8-b7e0-ac213cb84e0a req-61034c56-8178-476c-ae01-bcf43f4abd3d service nova] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 852.944837] env[65107]: INFO networking_nsxv3.common.synchronization [req-6dc4ae1f-00d7-4ed8-b7e0-ac213cb84e0a req-61034c56-8178-476c-ae01-bcf43f4abd3d service nova] Enqueued Resource ID: 792c3fd1-9eab-4d0c-812e-5ddaa132069a with Priority: HIGHEST for action port [ 852.945407] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 852.945544] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 852.945642] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792c3fd1-9eab-4d0c-812e-5ddaa132069a with Priority: HIGHEST for action port [ 852.950169] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.950360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.950473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.950727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.950841] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.951878] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.952020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.952184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.952320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.952421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.952517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.952580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.952767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.952850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.952941] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.954307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-792c3fd1-9eab-4d0c-812e-5ddaa132069a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.954307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.954307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.954513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.954513] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792c3fd1-9eab-4d0c-812e-5ddaa132069a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.038708] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.212779] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.212868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.212944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.213196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.213301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.213433] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be created. [ 853.240433] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.240433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.240433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.240433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.240433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.253987] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: UNINITIALIZED for 2s [ 853.456564] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.456662] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.457102] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.458082] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 792c3fd1-9eab-4d0c-812e-5ddaa132069a with status ACTIVE [ 853.458339] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.458490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.458573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.458863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.458981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.459261] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.459397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.459480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.459683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.459785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.460041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.460174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.460350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.460554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.460674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.460791] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 792c3fd1-9eab-4d0c-812e-5ddaa132069a is going to be updated. [ 853.485216] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.485216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.485216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.485454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.485539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.485717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-792c3fd1-9eab-4d0c-812e-5ddaa132069a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.541497] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.541497] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.541497] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.541704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.541804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.541908] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be updated. [ 853.599492] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.599677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.599771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.600064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.600121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.613886] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 853.834294] env[65107]: INFO networking_nsxv3.common.synchronization [req-e703c3d3-a0e2-4866-8f1d-a73ae218f3c0 req-9f16c7e8-6361-4717-8f77-ef7281111bad tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 853.835025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 853.835194] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.835475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.835605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.835860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.836144] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.836221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.836289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.836501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.836583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.836698] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.963183] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.195743] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.195967] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.196077] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.196413] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.196691] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.196829] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.196965] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.197642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.197826] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.198435] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.198696] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.198814] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.198923] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.199172] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.199288] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.199421] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.229169] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.229169] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.229169] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.229169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.229169] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-f13f163e-29d4-4d7b-afd0-afceaaa92082 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.229421] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.229421] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.230355] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.230355] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f13f163e-29d4-4d7b-afd0-afceaaa92082',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.339933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.340121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.340213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.340427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.340520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.340719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.340822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.340919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.341788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.341788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.341788] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d already deleted. [ 854.341788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.465982] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.466182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.466232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.466431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.466526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.466655] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be created. [ 854.492884] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.492884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.492884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.493240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.493240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.504722] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: UNINITIALIZED for 2s [ 854.732957] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.733212] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.733334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.733734] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.733888] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.734052] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port f13f163e-29d4-4d7b-afd0-afceaaa92082 not found, creating... [ 854.734332] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.734495] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.734607] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.734880] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.735014] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.735317] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.735472] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.735585] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.735982] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.736862] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.737018] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: f13f163e-29d4-4d7b-afd0-afceaaa92082 is going to be created. [ 854.770479] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.770683] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.770810] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.771204] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.772246] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.772535] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.262572] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 855.262961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.262961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.263139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.263376] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.263536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.263633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.263766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.263883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.263975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.264092] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.566046] env[65107]: INFO networking_nsxv3.common.synchronization [req-e703c3d3-a0e2-4866-8f1d-a73ae218f3c0 req-49db81f3-d2c2-4109-aa6c-3832c70eb3b7 service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 855.566270] env[65107]: INFO networking_nsxv3.common.synchronization [req-e703c3d3-a0e2-4866-8f1d-a73ae218f3c0 req-49db81f3-d2c2-4109-aa6c-3832c70eb3b7 service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 855.566408] env[65107]: INFO networking_nsxv3.common.synchronization [req-e703c3d3-a0e2-4866-8f1d-a73ae218f3c0 req-49db81f3-d2c2-4109-aa6c-3832c70eb3b7 service nova] Enqueued Resource ID: f13f163e-29d4-4d7b-afd0-afceaaa92082 with Priority: HIGHEST for action port [ 855.567010] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 855.567207] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 855.567268] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f13f163e-29d4-4d7b-afd0-afceaaa92082 with Priority: HIGHEST for action port [ 855.567721] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.567721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.567721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.567942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.567978] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.569653] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.569821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.569924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.570361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.570542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.570703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.570810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.571086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.571211] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.571360] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.573091] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f13f163e-29d4-4d7b-afd0-afceaaa92082 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.573225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.573283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.573434] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.573520] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f13f163e-29d4-4d7b-afd0-afceaaa92082',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.623726] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 855.623945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.625490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.625490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.625490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.625490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.625490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.625490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.625490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.625490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.625490] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.767046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.767046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.767348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.767438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.767645] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.767764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.767824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.768029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.768123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.768222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.768887] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.768887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.768887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.768887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.768887] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.769285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.769285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.769285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.769285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.769285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.769472] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.070942] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.070942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.076439] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f13f163e-29d4-4d7b-afd0-afceaaa92082 with status ACTIVE [ 856.076686] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.076819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.076888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.077851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.077851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.077851] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.077851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.077851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.078162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.078162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.078231] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.078342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.078403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.078552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.078627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.078715] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f13f163e-29d4-4d7b-afd0-afceaaa92082 is going to be updated. [ 856.079868] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.101459] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.101554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.101608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.101807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.101960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.102157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f13f163e-29d4-4d7b-afd0-afceaaa92082" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.126707] env[65107]: INFO networking_nsxv3.common.synchronization [req-9ce30b16-26a6-4dcd-a13b-505ec3735ec7 req-ed8073c4-1ffc-41b7-9d7d-75db31872fe0 tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 856.127956] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.128625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.128752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.129190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.129378] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.129485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.129567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.129736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.129826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.129913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.130097] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.130199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.130257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.130412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.134022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.134022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.134022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.134022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.134022] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.134022] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 856.134022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.134022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.134022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.134747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134747] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.134747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.134747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.134747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.134747] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.273209] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 814a62b8-5b9a-4a8b-96c6-18956744a0ed: rpc.has_security_group_logging(os_id): False [ 856.291265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.291442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.291481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.291689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.291781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.292036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.292099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.292201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.292329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.292376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.292561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.292742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.292742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.292855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.292949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.293095] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.293601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.293681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.294419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.294419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.294419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be created. [ 856.367281] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.367510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.367610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.367808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.368027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.387014] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 856.520207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 856.520565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.520851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.521302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.521607] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.521794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.521900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.522172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.522422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.522513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.522579] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.582062] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.637560] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2bd5d37-9901-465a-8751-6c1cb28889e3: rpc.has_security_group_logging(os_id): False [ 856.638799] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.638934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.639009] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.640175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.640175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.640175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.640175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.640175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.640175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.640175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.640175] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 856.657683] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.657873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.657873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.658076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.658169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.658354] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.658474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.658542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.658641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.658708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.658895] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.658992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.659074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.659209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.659288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.660177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.660177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.660177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.660177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.660177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.660177] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be updated. [ 856.673209] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.673384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.673441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.673663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.673800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.682114] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 856.724302] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.724447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.724516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.724731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.724871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.752448] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 857.030922] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.083756] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.083936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.084062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.084252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.084337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.084413] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be created. [ 857.107961] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.108269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.108269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.108473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.108617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.118599] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: UNINITIALIZED for 2s [ 857.536411] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfc0215e-9e19-4ef1-8f09-6aafac54a47f: rpc.has_security_group_logging(os_id): False [ 857.554098] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.554450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.554450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.554595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.554666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.554914] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.555054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.555124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.555279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.555420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.555470] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be created. [ 857.620772] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.620961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.621032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.621675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.621858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.634337] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 858.400345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 858.400578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.710397] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 858.710817] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 858.710817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.772024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 858.772024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.131801] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 859.132144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.132403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.132705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.132933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.133512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.133512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.133512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.133638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.133815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.133949] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.637144] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.649986] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 859.650400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.022627] env[65107]: INFO networking_nsxv3.common.synchronization [req-c5791965-9d35-4629-82e0-6c554850462d req-3abf5e31-073b-4ef5-b31c-08178db54872 tempest-ServersNegativeTestJSON-35009868 tempest-ServersNegativeTestJSON-35009868-project-member] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 860.023183] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 860.023494] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.023613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.023679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.023873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.024034] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.024134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.024197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.024337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.024517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.024517] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.140598] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11705357-9323-4e1c-bf51-81c8b975ee5d: rpc.has_security_group_logging(os_id): False [ 860.159564] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.159784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.159886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.160335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.160469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.160739] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.160873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.160957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.162457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.162550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.162643] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be created. [ 860.300135] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.300403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.300670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.300794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.301810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.313639] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 860.527569] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.030736] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.204585] env[65107]: INFO networking_nsxv3.common.synchronization [None req-a439a14e-d4b4-40a6-ac35-794dbef10828 None None] Enqueued Resource ID: ffc358b4-c5ef-4a52-a8aa-db9ac839004e with Priority: HIGHEST for action port [ 861.204742] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc358b4-c5ef-4a52-a8aa-db9ac839004e with Priority: HIGHEST for action port [ 861.205013] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffc358b4-c5ef-4a52-a8aa-db9ac839004e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.205143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffc358b4-c5ef-4a52-a8aa-db9ac839004e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.205215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffc358b4-c5ef-4a52-a8aa-db9ac839004e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.205503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffc358b4-c5ef-4a52-a8aa-db9ac839004e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.205578] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc358b4-c5ef-4a52-a8aa-db9ac839004e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.535068] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.535068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.535068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.535068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.535068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.535068] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be updated. [ 861.571214] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.571673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.571673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.571964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.571964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.581707] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 861.707678] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffc358b4-c5ef-4a52-a8aa-db9ac839004e [ 861.707678] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.707854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.707854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.708057] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.708287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.708287] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffc358b4-c5ef-4a52-a8aa-db9ac839004e already deleted. [ 861.708423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffc358b4-c5ef-4a52-a8aa-db9ac839004e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.326194] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 862.326194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.594117] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 863.594416] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.667691] env[65107]: INFO networking_nsxv3.common.synchronization [None req-25f97e0f-7262-4d96-b674-42ab7393b89a None None] Enqueued Resource ID: dd54be96-592d-45e0-8ae3-3882c1c7fefc with Priority: HIGHEST for action port [ 863.668487] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd54be96-592d-45e0-8ae3-3882c1c7fefc with Priority: HIGHEST for action port [ 863.668999] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd54be96-592d-45e0-8ae3-3882c1c7fefc taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.669174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd54be96-592d-45e0-8ae3-3882c1c7fefc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.669214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd54be96-592d-45e0-8ae3-3882c1c7fefc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.669544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd54be96-592d-45e0-8ae3-3882c1c7fefc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.669657] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd54be96-592d-45e0-8ae3-3882c1c7fefc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.173396] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd54be96-592d-45e0-8ae3-3882c1c7fefc [ 864.173713] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.173850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.173939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.174190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.174294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.174397] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd54be96-592d-45e0-8ae3-3882c1c7fefc already deleted. [ 864.174473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd54be96-592d-45e0-8ae3-3882c1c7fefc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.292229] env[65107]: INFO networking_nsxv3.common.synchronization [req-cd2d94b0-54ed-40e1-ac0e-94fe77a4819e req-2809e917-4393-4820-96de-6450cdea668a tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 864.292923] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 864.293268] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.293393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.293540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.293653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.293803] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.293899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.293960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.294118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.294202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.294298] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.797015] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.797015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.797439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.797439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.797439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.797544] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.797756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.797756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.797893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.797893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.797986] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 864.820535] env[65107]: INFO networking_nsxv3.common.synchronization [req-a237f8b9-13a8-45ff-9e29-b1ccae7e101f req-02b78724-2234-42c5-a79d-354844e12eac tempest-ServersTestManualDisk-1947433380 tempest-ServersTestManualDisk-1947433380-project-member] Enqueued Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_members [ 864.821089] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_members [ 864.821434] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.821557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.821620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.821874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.824051] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.824051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.824051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.824051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.824051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.824051] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.825388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.825491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.825559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.826314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.826465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.838657] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 865.194369] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.194565] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-453" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.194639] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-453" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.194989] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-453" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.195498] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.195498] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.195498] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.195739] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.195821] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.196069] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.196189] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.196301] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.196400] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.196501] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.197245] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.197245] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.216959] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.217192] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.217274] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.217447] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-453" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.217806] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.218026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.218154] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.218456] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.218596] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.330832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.330832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.330832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.330832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.330832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.330832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.331789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.331789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.331789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.331789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.331789] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de already deleted. [ 865.331789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.721542] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.725022] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e not found, creating... [ 865.725022] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.725022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.725437] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.725437] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.725437] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.725437] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.725437] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.725437] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e is going to be created. [ 865.747418] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.748081] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.748391] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.748797] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.749209] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.750097] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.545012] env[65107]: INFO networking_nsxv3.common.synchronization [req-a237f8b9-13a8-45ff-9e29-b1ccae7e101f req-f44e9497-2141-4cbb-8a1b-5d8bb2ce2123 service nova] Enqueued Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_rules [ 866.545618] env[65107]: INFO networking_nsxv3.common.synchronization [req-a237f8b9-13a8-45ff-9e29-b1ccae7e101f req-f44e9497-2141-4cbb-8a1b-5d8bb2ce2123 service nova] Enqueued Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_members [ 866.545618] env[65107]: INFO networking_nsxv3.common.synchronization [req-a237f8b9-13a8-45ff-9e29-b1ccae7e101f req-f44e9497-2141-4cbb-8a1b-5d8bb2ce2123 service nova] Enqueued Resource ID: aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e with Priority: HIGHEST for action port [ 866.546334] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_rules [ 866.546571] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_members [ 866.546713] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e with Priority: HIGHEST for action port [ 866.547059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.547207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.547313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.547504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.547575] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.550930] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.551282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.551282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.551457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.551553] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.553133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.553251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.553646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.553646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.553646] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.555319] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.555453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.555557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.555745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.555926] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.848738] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 866.849032] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed deletion is rescheduled due to dependency. [ 866.849137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.052903] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.052903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.055959] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.058559] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e with status ACTIVE [ 867.058767] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.059066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.059066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.059182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.059276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.059572] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.059572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.060139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.060139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.060139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.060139] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.060139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.060139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.061130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.061130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.061130] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e is going to be updated. [ 867.085812] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.085997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.086128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.086320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.086465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.086623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aee60602-bbf1-4ac1-91a4-dd1f8b6ca96e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.557886] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.954075] env[65107]: INFO networking_nsxv3.common.synchronization [req-903929aa-c9d6-40d8-a4d7-f3c82faea162 req-ba4287c9-5fc6-42ae-8fe7-5097e7ff31aa tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_members [ 867.954661] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGHEST for action security_group_members [ 867.954983] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.955129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.955204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.955403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.955566] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.955665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.955737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.955886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.955976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.956098] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.063657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.063657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.063657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.063657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.063657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.063657] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de is going to be created. [ 868.090701] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.090846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.090894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.091134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.091357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.101192] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de in Status: UNINITIALIZED for 2s [ 868.271916] env[65107]: INFO networking_nsxv3.common.synchronization [req-e886fa5e-582a-4169-9fa3-0a463c667ae5 req-90d26056-65ab-4a33-927a-e5e3b31be33b tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 868.273290] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 868.274083] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.274083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.276432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.276432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.276432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.276432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.276432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.276432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.276432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.276432] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.458424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.458562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.458640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.459030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.459100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.459423] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.459539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.459595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.459769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.459846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.459938] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 is going to be updated. [ 868.492988] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.493303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.493303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.493439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.494246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.506517] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: IN_PROGRESS for 2s [ 868.704885] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.705203] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.705305] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.705632] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.709054] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.709054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.709054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.709054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.709054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.709054] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.709054] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.709054] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.709054] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.709054] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.709054] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.709054] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.730072] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.730305] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 868.730476] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.731088] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.731571] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-7225f490-a701-4bda-936b-1ab70ad4354c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.731815] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.731964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.732346] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.732549] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7225f490-a701-4bda-936b-1ab70ad4354c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.780678] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.234914] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.235245] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.235411] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.235727] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.235882] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.236049] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 7225f490-a701-4bda-936b-1ab70ad4354c not found, creating... [ 869.236309] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.236466] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.236577] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.236785] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.236916] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.237203] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.237354] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.237465] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.237661] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.237790] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.237923] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 7225f490-a701-4bda-936b-1ab70ad4354c is going to be created. [ 869.260218] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.260380] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.260380] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.260631] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.260850] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.261158] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.284133] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.791442] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.791795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.794466] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.794622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.794723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.794829] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 869.825733] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.825971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.825971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.826420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.826420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.837117] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 869.983952] env[65107]: INFO networking_nsxv3.common.synchronization [req-e886fa5e-582a-4169-9fa3-0a463c667ae5 req-5e46df69-650b-4b75-b823-be75545f2794 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 869.984248] env[65107]: INFO networking_nsxv3.common.synchronization [req-e886fa5e-582a-4169-9fa3-0a463c667ae5 req-5e46df69-650b-4b75-b823-be75545f2794 service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 869.984478] env[65107]: INFO networking_nsxv3.common.synchronization [req-e886fa5e-582a-4169-9fa3-0a463c667ae5 req-5e46df69-650b-4b75-b823-be75545f2794 service nova] Enqueued Resource ID: 7225f490-a701-4bda-936b-1ab70ad4354c with Priority: HIGHEST for action port [ 869.985189] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 869.985395] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 869.985590] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7225f490-a701-4bda-936b-1ab70ad4354c with Priority: HIGHEST for action port [ 869.986059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.986241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.986347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.986645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.986774] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.988354] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.988503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.988800] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7225f490-a701-4bda-936b-1ab70ad4354c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.988958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.989130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.989332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.989447] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7225f490-a701-4bda-936b-1ab70ad4354c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.111404] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de in Status: SUCCESS [ 870.111731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.111977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.112236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.112506] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.112645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.112645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.112818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.112898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.112980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.113085] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.491877] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.492317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.492392] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7225f490-a701-4bda-936b-1ab70ad4354c with status ACTIVE [ 870.492583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.492666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.492730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.492930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.493031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.493203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.493713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.493713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.493713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.493713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.494166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.494166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.494166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.494166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.494166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.494468] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7225f490-a701-4bda-936b-1ab70ad4354c is going to be updated. [ 870.524316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.524598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.524598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.524737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.524835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.524995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7225f490-a701-4bda-936b-1ab70ad4354c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.525749] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916be366-a55f-4f65-b259-ce2263c7c963 in Status: SUCCESS [ 870.525907] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 deletion is rescheduled due to dependency. [ 870.526014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.616612] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.030378] env[65107]: INFO networking_nsxv3.common.synchronization [req-16b067ff-9032-46bc-a93c-7cea330f658f req-1af03335-2f98-4050-8702-6cdb6e40a569 tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_members [ 871.030378] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_members [ 871.030849] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.030849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.030849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.031043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.031895] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.031895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.031895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.031895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.031895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.032314] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.119477] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c79582fb-f77d-4ad5-82e7-7e6d22e686de: rpc.has_security_group_logging(os_id): False [ 871.139417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.139650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.139717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.139957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.140075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.140316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.141178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.141178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.141178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.141178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.141178] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de is going to be created. [ 871.205741] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.205741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.205741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.206026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.207338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.221061] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de in Status: IN_PROGRESS for 2s [ 871.534758] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.535069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.535069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.535248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.535345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.535579] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.535767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.535767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.535890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.535965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.536063] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 already deleted. [ 871.536119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.548210] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.548476] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.548568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.548970] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.549354] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.549547] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.549655] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.550100] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.550355] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.550606] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.550743] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.550854] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.550994] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.551219] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.551572] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.551751] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.591269] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.591530] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.591662] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.591839] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-234" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.592274] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.592495] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.592629] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.592961] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.593113] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.847040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 871.847283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.847469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.847692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.847881] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.848014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.848107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.848236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.848307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.848406] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.095339] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.095705] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.095705] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.095979] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.096153] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.096302] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c not found, creating... [ 872.096565] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.096717] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.096853] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.097080] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.097214] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.097486] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.097632] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.097754] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.097954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.098093] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.098226] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c is going to be created. [ 872.118904] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.119155] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.119309] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.119593] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.119824] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.120078] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.350884] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.820539] env[65107]: INFO networking_nsxv3.common.synchronization [req-16b067ff-9032-46bc-a93c-7cea330f658f req-9e5f2c75-74c2-4d94-bda8-00f879665553 service nova] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_rules [ 872.820539] env[65107]: INFO networking_nsxv3.common.synchronization [req-16b067ff-9032-46bc-a93c-7cea330f658f req-9e5f2c75-74c2-4d94-bda8-00f879665553 service nova] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_members [ 872.820539] env[65107]: INFO networking_nsxv3.common.synchronization [req-16b067ff-9032-46bc-a93c-7cea330f658f req-9e5f2c75-74c2-4d94-bda8-00f879665553 service nova] Enqueued Resource ID: bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c with Priority: HIGHEST for action port [ 872.820976] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_rules [ 872.820976] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_members [ 872.820976] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c with Priority: HIGHEST for action port [ 872.821285] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.821411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.821626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.821894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.821894] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.822601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.822718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.822785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.822951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.823112] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.823203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.823265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.823405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.823494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.823585] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.825929] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.826133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.826133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.826255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.826331] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.853603] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.235948] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de in Status: SUCCESS [ 873.236410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.328048] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.328258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.328759] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.329301] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c with status ACTIVE [ 873.329570] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.329718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.329788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.329994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.330101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.330280] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.330376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.330441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.330600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.330680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.330862] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.330954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.331025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.331164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.331237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.331347] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c is going to be updated. [ 873.356923] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.357103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.357234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.357773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.357773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.357971] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 873.361264] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.361264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.361264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.361264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.361529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.361743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc7cc5cd-08e7-4d8b-a131-dad4e95fa73c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.390719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.390945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.390999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.391249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.391505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.402268] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 873.834538] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.338547] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.338862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.340300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.340889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.341189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.341389] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 is going to be created. [ 874.383363] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.383593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.383671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.383886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.384118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.398736] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: UNINITIALIZED for 2s [ 875.417580] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 875.420544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.421104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.421344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.421737] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.421981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.423524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.423767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.424015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.424112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.424220] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.703436] env[65107]: INFO networking_nsxv3.common.synchronization [req-aa86f57e-6e2b-4146-bfad-9e1e660c9a77 req-a7eecc33-0be3-48b0-ab9a-b25b87d026fb tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 875.704089] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 875.704437] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.704563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.704632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.704837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.705017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.705276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.705375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.705891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.705891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.705891] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.930029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.930029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.930029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.930029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.930029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.930731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.930845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.931059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.931264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.931485] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.210726] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.411126] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: SUCCESS [ 876.411595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.412833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.412833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.412833] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.412833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.412833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.412833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.412833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.412833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.412833] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.434327] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57ccc978-a1f0-4c03-8296-5acfbdaf68e4: rpc.has_security_group_logging(os_id): False [ 876.458729] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.458944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.458996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.459279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.459629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.459901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.460038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.460126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.460335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.460463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.460724] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.460852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.460928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.461171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.461310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.461582] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.461708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.461762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.461941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.462031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.462122] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 876.558633] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.558766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.558766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.558986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.559246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.586774] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 876.713926] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.916584] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.217478] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.217731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.217731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.217953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.218075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.218211] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 877.254359] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.254578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.254668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.254981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.255168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.267105] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 877.418570] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5166db24-d7b9-43dd-8152-fa49fdb2e750: rpc.has_security_group_logging(os_id): False [ 877.448432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.448775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.448775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.448892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.449019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.449680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.449840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.449884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.450077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.450126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.450216] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 is going to be created. [ 877.545133] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.545133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.545133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.545133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.545133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.563574] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: IN_PROGRESS for 2s [ 878.606249] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 878.606249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.850154] env[65107]: INFO networking_nsxv3.common.synchronization [req-d4cfca39-977a-4b8b-aaff-57df7ce2521e req-8b89bbaf-ff9a-4204-8933-53730ed71878 tempest-ServersNegativeTestMultiTenantJSON-69193996 tempest-ServersNegativeTestMultiTenantJSON-69193996-project-member] Enqueued Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_members [ 878.850154] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_members [ 878.850677] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.851034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.851214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.851777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.852083] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.852514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.852720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.852983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.853604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.853798] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.279807] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 879.279948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.356394] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.356599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.356675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.356930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.357045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.357248] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.357356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.357420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.357574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.357650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.357734] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 already deleted. [ 879.357823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.460357] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.460631] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-484" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.460822] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-484" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.461278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-484" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.461621] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.461891] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.461891] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.462175] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.462356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.462646] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.462791] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.462890] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.462994] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.463127] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.463239] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.463375] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.481921] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.482097] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.482299] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.482499] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-484" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.482843] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-c7008e08-33c0-4b76-b13c-de744024ece5 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.483036] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.483158] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.483483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.483689] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7008e08-33c0-4b76-b13c-de744024ece5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.530467] env[65107]: INFO networking_nsxv3.common.synchronization [None req-8dd1f294-1393-416e-b046-fb5db31f787c None None] Enqueued Resource ID: dece95ad-943d-473a-9e93-3980ffacd11f with Priority: HIGHEST for action port [ 879.531591] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dece95ad-943d-473a-9e93-3980ffacd11f with Priority: HIGHEST for action port [ 879.531986] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-dece95ad-943d-473a-9e93-3980ffacd11f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.532129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dece95ad-943d-473a-9e93-3980ffacd11f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.532199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dece95ad-943d-473a-9e93-3980ffacd11f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.532487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dece95ad-943d-473a-9e93-3980ffacd11f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.532807] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dece95ad-943d-473a-9e93-3980ffacd11f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.577281] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: SUCCESS [ 879.577432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.986228] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.986538] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.986641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.987400] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.987608] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.987770] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port c7008e08-33c0-4b76-b13c-de744024ece5 not found, creating... [ 879.988055] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.988248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.988358] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.988621] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.988765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.989086] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.989241] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.989412] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.989636] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.989769] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.990574] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: c7008e08-33c0-4b76-b13c-de744024ece5 is going to be created. [ 880.017591] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.017862] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.017990] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.018331] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.018594] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.019405] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.036263] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dece95ad-943d-473a-9e93-3980ffacd11f [ 880.036594] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.036811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.036923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.038495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.038717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.038838] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dece95ad-943d-473a-9e93-3980ffacd11f already deleted. [ 880.038958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dece95ad-943d-473a-9e93-3980ffacd11f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.902274] env[65107]: INFO networking_nsxv3.common.synchronization [req-d4cfca39-977a-4b8b-aaff-57df7ce2521e req-48af1bf0-5afa-407a-bde3-bf5d8dec2e1f service nova] Enqueued Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_rules [ 880.902505] env[65107]: INFO networking_nsxv3.common.synchronization [req-d4cfca39-977a-4b8b-aaff-57df7ce2521e req-48af1bf0-5afa-407a-bde3-bf5d8dec2e1f service nova] Enqueued Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_members [ 880.902723] env[65107]: INFO networking_nsxv3.common.synchronization [req-d4cfca39-977a-4b8b-aaff-57df7ce2521e req-48af1bf0-5afa-407a-bde3-bf5d8dec2e1f service nova] Enqueued Resource ID: c7008e08-33c0-4b76-b13c-de744024ece5 with Priority: HIGHEST for action port [ 880.903358] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_rules [ 880.903645] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_members [ 880.903645] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7008e08-33c0-4b76-b13c-de744024ece5 with Priority: HIGHEST for action port [ 880.903984] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.904096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.904146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.904408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.904541] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.905905] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.908652] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.908652] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.908652] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7008e08-33c0-4b76-b13c-de744024ece5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.908652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.908652] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7008e08-33c0-4b76-b13c-de744024ece5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.411964] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.413105] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.413105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.413847] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7008e08-33c0-4b76-b13c-de744024ece5 with status ACTIVE [ 881.413847] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.413847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.413847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.414170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.414170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.414388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.414388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.414532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.414583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.414655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.415098] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.415098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.415098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.416350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.416441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.416539] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7008e08-33c0-4b76-b13c-de744024ece5 is going to be updated. [ 881.461108] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.461108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.461301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.462856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.462856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.462856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7008e08-33c0-4b76-b13c-de744024ece5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.916200] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.181431] env[65107]: INFO networking_nsxv3.common.synchronization [None req-d574be7d-8244-492c-bb31-da452249fc65 None None] Enqueued Resource ID: d273f38a-9310-4aed-a68a-caaaa5b21db6 with Priority: HIGHEST for action port [ 882.182210] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d273f38a-9310-4aed-a68a-caaaa5b21db6 with Priority: HIGHEST for action port [ 882.182570] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d273f38a-9310-4aed-a68a-caaaa5b21db6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.182739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d273f38a-9310-4aed-a68a-caaaa5b21db6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.182932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d273f38a-9310-4aed-a68a-caaaa5b21db6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.183062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d273f38a-9310-4aed-a68a-caaaa5b21db6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.183175] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d273f38a-9310-4aed-a68a-caaaa5b21db6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.418095] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.418492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.418492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.418633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.418750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.418851] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 is going to be created. [ 882.453084] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.453344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.454049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.454049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.454049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.470547] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 in Status: UNINITIALIZED for 2s [ 882.686485] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d273f38a-9310-4aed-a68a-caaaa5b21db6 [ 882.686668] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.686770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.686878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.687632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.687632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.687632] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d273f38a-9310-4aed-a68a-caaaa5b21db6 already deleted. [ 882.687632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d273f38a-9310-4aed-a68a-caaaa5b21db6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.739023] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0ee561c0-edf4-411b-bb47-376425c34042 None None] Enqueued Resource ID: 8ebcb681-0bbe-48b9-a997-69c808653693 with Priority: HIGHEST for action port [ 883.739023] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebcb681-0bbe-48b9-a997-69c808653693 with Priority: HIGHEST for action port [ 883.739023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ebcb681-0bbe-48b9-a997-69c808653693 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.739023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ebcb681-0bbe-48b9-a997-69c808653693" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.739778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ebcb681-0bbe-48b9-a997-69c808653693" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.740169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ebcb681-0bbe-48b9-a997-69c808653693" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.740427] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ebcb681-0bbe-48b9-a997-69c808653693',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.243967] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ebcb681-0bbe-48b9-a997-69c808653693 [ 884.243967] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.243967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.244126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.244246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.244336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.244428] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ebcb681-0bbe-48b9-a997-69c808653693 already deleted. [ 884.244509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ebcb681-0bbe-48b9-a997-69c808653693" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.423527] env[65107]: INFO networking_nsxv3.common.synchronization [req-5029d65d-9719-4953-b996-3b8100504634 req-694a08c6-88ea-4e17-b85c-239f16d7ea18 tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 884.424325] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 884.424704] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.424824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.424893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.425209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.425507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.425930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.425930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.426040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.426082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.426228] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.485872] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 in Status: SUCCESS [ 884.486234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.486409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.486643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.486838] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.486948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.487026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.487185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.487263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.487346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.487437] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.894818] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.895160] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.895160] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.895400] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.895653] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.895811] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.895927] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.896156] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.896296] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.896503] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.896619] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.896724] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.896828] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.896932] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.897046] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.897176] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.917007] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.917198] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.917340] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.917553] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.917881] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-01927873-0573-4e7a-aee9-4b6b220235dd taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.918103] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.918228] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.918568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.918725] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01927873-0573-4e7a-aee9-4b6b220235dd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.930635] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.930781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.930851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.931076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.931172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.931364] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.931460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.931526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.931705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.931781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.931866] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 884.964179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.964179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.964179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.964179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.964179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.975324] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 884.991396] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.991582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.991751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.992074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.992315] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.993159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.993159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.993159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.993159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.993159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.993159] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.993854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.993854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.993854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.993854] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.993854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.994237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.994237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.994237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.994324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.994914] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.429955] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.429955] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 01927873-0573-4e7a-aee9-4b6b220235dd not found, creating... [ 885.429955] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.429955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.430515] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.430515] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.430515] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.430515] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.430653] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.430855] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 01927873-0573-4e7a-aee9-4b6b220235dd is going to be created. [ 885.453403] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.453658] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.453804] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.454110] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.454368] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.454863] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.497817] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2af66a0-d07a-4cd7-8b33-9e5aee256d06: rpc.has_security_group_logging(os_id): False [ 885.519963] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.520223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.520287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.520513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.520640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.520844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.520934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.521037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.521208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.521289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.521510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.521661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.521725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.521865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.521976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.522685] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.522799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.522897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.523135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.523220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.523310] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 is going to be created. [ 885.633991] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.634234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.634280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.635147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.635147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.651917] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 in Status: IN_PROGRESS for 2s [ 885.946473] env[65107]: INFO networking_nsxv3.common.synchronization [None req-dd526b2c-8291-48e0-97a3-1d23e27fa0b7 None None] Enqueued Resource ID: ca2f5ad8-a430-4817-abaa-78505db1c357 with Priority: HIGHEST for action port [ 885.946738] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2f5ad8-a430-4817-abaa-78505db1c357 with Priority: HIGHEST for action port [ 885.946890] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca2f5ad8-a430-4817-abaa-78505db1c357 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.947270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca2f5ad8-a430-4817-abaa-78505db1c357" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.947270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca2f5ad8-a430-4817-abaa-78505db1c357" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.949650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca2f5ad8-a430-4817-abaa-78505db1c357" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.949650] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca2f5ad8-a430-4817-abaa-78505db1c357',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.220220] env[65107]: INFO networking_nsxv3.common.synchronization [req-5029d65d-9719-4953-b996-3b8100504634 req-70be1baa-235b-4f72-abdb-a517a3a0e10c service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 886.220357] env[65107]: INFO networking_nsxv3.common.synchronization [req-5029d65d-9719-4953-b996-3b8100504634 req-70be1baa-235b-4f72-abdb-a517a3a0e10c service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 886.220551] env[65107]: INFO networking_nsxv3.common.synchronization [req-5029d65d-9719-4953-b996-3b8100504634 req-70be1baa-235b-4f72-abdb-a517a3a0e10c service nova] Enqueued Resource ID: 01927873-0573-4e7a-aee9-4b6b220235dd with Priority: HIGHEST for action port [ 886.221160] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 886.221482] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 886.221482] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01927873-0573-4e7a-aee9-4b6b220235dd with Priority: HIGHEST for action port [ 886.222656] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.222656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.222656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.222858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.222888] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.223737] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.223826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.224050] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-01927873-0573-4e7a-aee9-4b6b220235dd taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.224154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.224214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.224384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.224456] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01927873-0573-4e7a-aee9-4b6b220235dd',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.451365] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca2f5ad8-a430-4817-abaa-78505db1c357 [ 886.451680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.451870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.451972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.452317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.452501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.452690] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca2f5ad8-a430-4817-abaa-78505db1c357 already deleted. [ 886.452782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca2f5ad8-a430-4817-abaa-78505db1c357" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.455023] env[65107]: INFO networking_nsxv3.common.synchronization [None req-ccc1de45-d7a6-4460-bc1f-aa9a95044553 None None] Enqueued Resource ID: 8164ec9d-bdc9-4b9c-baa5-180e04ae56cc with Priority: HIGHEST for action port [ 886.455101] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8164ec9d-bdc9-4b9c-baa5-180e04ae56cc with Priority: HIGHEST for action port [ 886.455570] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8164ec9d-bdc9-4b9c-baa5-180e04ae56cc taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.455761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8164ec9d-bdc9-4b9c-baa5-180e04ae56cc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.455869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8164ec9d-bdc9-4b9c-baa5-180e04ae56cc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.456255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8164ec9d-bdc9-4b9c-baa5-180e04ae56cc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.456436] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8164ec9d-bdc9-4b9c-baa5-180e04ae56cc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.729161] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01927873-0573-4e7a-aee9-4b6b220235dd with status ACTIVE [ 886.729384] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.729569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.729653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.730285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.730285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.730584] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.730917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.731054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.731275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.731388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.731736] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.732052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.732130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.732293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.732444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.732590] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01927873-0573-4e7a-aee9-4b6b220235dd is going to be updated. [ 886.734326] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.734560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.762434] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.762614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.762691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.762915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.763095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.763254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01927873-0573-4e7a-aee9-4b6b220235dd" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.960070] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8164ec9d-bdc9-4b9c-baa5-180e04ae56cc [ 886.960497] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.962535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.962535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.962535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.962535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.962535] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8164ec9d-bdc9-4b9c-baa5-180e04ae56cc already deleted. [ 886.962535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8164ec9d-bdc9-4b9c-baa5-180e04ae56cc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.986824] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 886.986939] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 886.987162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.988040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.988040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.988040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.988040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.988040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.988297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.988297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.988358] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.491422] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.666470] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 in Status: SUCCESS [ 887.667077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.994181] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.497902] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.498134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.498202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.498439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.498564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.498677] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 888.531627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.531817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.531864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.532111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.532259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.548719] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 889.875763] env[65107]: INFO networking_nsxv3.common.synchronization [req-8f893b4c-a1d9-4e41-9186-24c4837c0c6c req-610e2073-4ad5-4403-bf5b-aa3ee7b89316 tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 889.876419] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 889.876742] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.876898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.876948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.877218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.877417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.877555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.877864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.877864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.877983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.878066] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.380827] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.565207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 890.565207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.565207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.565391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.565583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.565751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.565841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.566110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.566222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.566336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.567076] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.884034] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.070685] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.070685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.070685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.070872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.071261] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.071261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.071261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.071426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.071426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.071520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.072517] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.072517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.072517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.072517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.072517] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.072517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.072517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.072891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.072891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.072891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.072891] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.386862] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.386862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.386862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.387153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.387316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.387477] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 891.421583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.421846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.421916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.422433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.422433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.435532] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 891.576055] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6970c294-30ba-4814-9be8-ff7a47ecd5e8: rpc.has_security_group_logging(os_id): False [ 891.598089] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.598240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.598304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.598530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.599127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.599127] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.599127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.599127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.599127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.599369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.599401] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.599481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.599542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.599737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.599796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.599982] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.600307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.600307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.600307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.600450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.600450] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 891.688595] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.688787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.688830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.689013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.689167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.709371] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 892.239915] env[65107]: INFO networking_nsxv3.common.synchronization [req-850a6fe9-67ed-47d6-b3d9-03edfc0c1206 req-147793d1-5e57-4b5a-b330-d0a3b866e98d tempest-ServerGroupTestJSON-208493729 tempest-ServerGroupTestJSON-208493729-project-member] Enqueued Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_members [ 892.240349] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_members [ 892.240663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.240801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.240837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.241101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.241259] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.241536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.241622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.242307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.242379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.242435] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.644680] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.644878] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.644995] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.645346] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.645602] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.645754] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.645866] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.646238] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.646406] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.646617] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.646728] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.646833] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.646938] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.647053] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.647154] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.647281] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.667902] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.668090] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.668224] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.668405] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-701" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.668718] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.668890] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.669017] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.669353] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.669494] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f58ebd-2542-4672-b2d3-87fc9009a2c1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.745013] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.745272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.745372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.745641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.745753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.746075] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.746158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.746158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.746374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.746474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.746561] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 already deleted. [ 892.746645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.172057] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.172437] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.172437] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.172772] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.172966] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.173112] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port b4f58ebd-2542-4672-b2d3-87fc9009a2c1 not found, creating... [ 893.173388] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.173564] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.173706] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.173986] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.174144] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.174483] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.174642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.174753] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.174957] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.175121] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.175271] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: b4f58ebd-2542-4672-b2d3-87fc9009a2c1 is going to be created. [ 893.198671] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.199097] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.199617] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.200052] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.200234] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.200471] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.208320] env[65107]: INFO networking_nsxv3.common.synchronization [req-f7518299-e1d9-4e26-b65f-5fe5008e7775 req-ac1b3251-8ca2-4102-8e9f-60d27f703790 tempest-MigrationsAdminTest-1967309458 tempest-MigrationsAdminTest-1967309458-project-member] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 893.208939] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 893.209348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.209449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.209449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.209701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.209864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.209963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.210043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.210194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.210277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.210368] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.452043] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 893.452333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.711882] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.726877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 893.727130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.919358] env[65107]: INFO networking_nsxv3.common.synchronization [req-850a6fe9-67ed-47d6-b3d9-03edfc0c1206 req-e50f4367-67b1-4761-9fd1-2cad0c7a8e73 service nova] Enqueued Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_rules [ 893.919358] env[65107]: INFO networking_nsxv3.common.synchronization [req-850a6fe9-67ed-47d6-b3d9-03edfc0c1206 req-e50f4367-67b1-4761-9fd1-2cad0c7a8e73 service nova] Enqueued Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_members [ 893.919358] env[65107]: INFO networking_nsxv3.common.synchronization [req-850a6fe9-67ed-47d6-b3d9-03edfc0c1206 req-e50f4367-67b1-4761-9fd1-2cad0c7a8e73 service nova] Enqueued Resource ID: b4f58ebd-2542-4672-b2d3-87fc9009a2c1 with Priority: HIGHEST for action port [ 893.919358] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_rules [ 893.919358] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_members [ 893.919358] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4f58ebd-2542-4672-b2d3-87fc9009a2c1 with Priority: HIGHEST for action port [ 893.919790] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.919790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.919878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.920287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.920287] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.921157] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.921235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.921317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.921598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.921598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.921742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.921778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.922089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.922089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.922089] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.923177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.923289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.923369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.923487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.923561] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f58ebd-2542-4672-b2d3-87fc9009a2c1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.107725] env[65107]: INFO networking_nsxv3.common.synchronization [None req-1835a07f-9315-45f7-a384-8df3aacf227a tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_rules [ 894.108323] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_rules [ 894.108671] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65c1ee26-a734-444a-b046-00bdd1cd350d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.108868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.108904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.109462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.109462] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.204023] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7572c5bc-92b9-473f-a5bb-baf312f11844 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_rules [ 894.204543] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_rules [ 894.204857] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65c1ee26-a734-444a-b046-00bdd1cd350d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.204960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.216915] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.363267] env[65107]: INFO networking_nsxv3.common.synchronization [req-65f3872e-9e0f-40df-9873-c77a8a743979 req-a649e048-c6dd-440f-b583-a1f05fb074f2 tempest-ServersNegativeTestMultiTenantJSON-69193996 tempest-ServersNegativeTestMultiTenantJSON-69193996-project-member] Enqueued Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_members [ 894.363818] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGHEST for action security_group_members [ 894.364443] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.364565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.364632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.364828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.364976] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.365085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.365147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.365290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.365373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.365628] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.424942] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.425081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.425213] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.426270] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4f58ebd-2542-4672-b2d3-87fc9009a2c1 with status ACTIVE [ 894.426375] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.426509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.426574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.426804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.427033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.428917] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.429071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.429151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.429362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.429465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.429684] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.429796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.429858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.430881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.430881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.431017] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4f58ebd-2542-4672-b2d3-87fc9009a2c1 is going to be updated. [ 894.456324] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.456858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.456858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.456858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.456858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.457059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4f58ebd-2542-4672-b2d3-87fc9009a2c1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.630338] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.630504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.630545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.630755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.631354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.631354] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65c1ee26-a734-444a-b046-00bdd1cd350d already deleted. [ 894.631354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.631354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.631354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.631583] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.719575] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.719754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.719754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.721031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.721031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.721031] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4197bdde-e214-41a5-8235-df774396919e is going to be updated. [ 894.767170] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.767347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.767399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.767622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.767773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.779696] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: IN_PROGRESS for 2s [ 894.867534] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.868238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.868238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.868238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.868371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.868635] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.868708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.868740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.868925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.869048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.869111] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 is going to be updated. [ 894.906208] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.906410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.906410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.906622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.906757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.918123] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 in Status: IN_PROGRESS for 2s [ 894.933693] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.151526] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.151849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.151978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.152253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.152430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.152560] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65c1ee26-a734-444a-b046-00bdd1cd350d already deleted. [ 895.152742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.436304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.436481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.436557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.436786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.437095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.437095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 is going to be created. [ 895.462091] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.462397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.462397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.462553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.462853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.474410] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 in Status: UNINITIALIZED for 2s [ 895.818769] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-77db02c5-95f6-495c-baee-1d295ec33a30 tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 895.819244] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 895.819767] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.819920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.820042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.820631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.820806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.821022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.821124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.821314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.821455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.821680] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.172140] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.172337] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.172454] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.172728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.173020] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.173192] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.173636] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.173636] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.173636] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.173837] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.173944] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.174056] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.174160] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.174264] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.174417] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.174489] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.193833] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.193975] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 896.194174] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.194410] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.194758] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-cf66670b-9658-478a-9945-d4a23a13e4f0 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.194857] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.194967] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.195309] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.195480] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf66670b-9658-478a-9945-d4a23a13e4f0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.324808] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.325936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.325936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.325936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.325936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.325936] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.325936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.325936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.326819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.327550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.327688] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 896.370205] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.370423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.370505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.371421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.371421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.379669] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 896.698755] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.699073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.699191] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.699487] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.699678] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.699844] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port cf66670b-9658-478a-9945-d4a23a13e4f0 not found, creating... [ 896.700125] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.700283] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.700398] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.700617] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.700753] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.701342] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.702016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.702016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.702016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.702016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.702234] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: cf66670b-9658-478a-9945-d4a23a13e4f0 is going to be created. [ 896.722695] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.723084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.723212] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.723592] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.723910] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.724258] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.791983] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: SUCCESS [ 896.792173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.928227] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 in Status: SUCCESS [ 896.928444] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 deletion is rescheduled due to dependency. [ 896.928561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.428097] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-b3462165-49a9-4e73-b58a-0a7f19324438 service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 897.428367] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-b3462165-49a9-4e73-b58a-0a7f19324438 service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 897.428543] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-b3462165-49a9-4e73-b58a-0a7f19324438 service nova] Enqueued Resource ID: cf66670b-9658-478a-9945-d4a23a13e4f0 with Priority: HIGHEST for action port [ 897.430075] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 897.430281] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 897.430439] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf66670b-9658-478a-9945-d4a23a13e4f0 with Priority: HIGHEST for action port [ 897.430814] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.430973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.431365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.431365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.431474] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.432431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.432571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.432836] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf66670b-9658-478a-9945-d4a23a13e4f0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.433012] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.433117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.433297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.433388] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf66670b-9658-478a-9945-d4a23a13e4f0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.485098] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 in Status: SUCCESS [ 897.485098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.485098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.485098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.485423] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.485423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.485423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.485530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.485557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.485708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.485842] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.935301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.935633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.936992] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf66670b-9658-478a-9945-d4a23a13e4f0 with status ACTIVE [ 897.937251] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.937430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.937479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.937652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.937741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.938259] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.938259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.938259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.938429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.938429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.938554] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.938637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.938684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.938796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.938869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.938952] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf66670b-9658-478a-9945-d4a23a13e4f0 is going to be updated. [ 897.962846] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.963050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.963347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.963347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.963927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.963927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf66670b-9658-478a-9945-d4a23a13e4f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.988360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.988526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.988597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.988805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.988984] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.989098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.989163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.989311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.989397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.989484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.989649] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.989796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.989843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.989964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.990117] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.990209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.990270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.990402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.990483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.990608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.990714] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.361800] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-bcd19b26-eaf8-41a8-982c-8965cdae3604 tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 898.362465] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 898.362789] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.362885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.392497] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 898.392744] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 deletion is rescheduled due to dependency. [ 898.392858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.393059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.393293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.393500] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.393629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.393711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.393853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.393921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.394096] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.493801] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e0fcae7-5a9f-402b-a906-9fb515e356a3: rpc.has_security_group_logging(os_id): False [ 898.512347] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.512498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.512557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.513340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.513340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.513340] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.513340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.513340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.513600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.513600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.513705] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.513794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.513852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.513984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.514167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.514366] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.514454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.514587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.514639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.514709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.514818] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 is going to be created. [ 898.582318] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.582579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.582644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.582931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.583163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.600300] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 in Status: IN_PROGRESS for 2s [ 898.741310] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.741513] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.741641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.741958] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.742221] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.742375] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.742489] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.742695] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.742889] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.743112] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.743225] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.743329] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.743434] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.743540] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.743641] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.743766] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.763486] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.763486] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.763667] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.763754] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-438" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.764390] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-fc5f2206-7e23-4c96-a6af-82ad12636a35 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.764390] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.764390] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.764792] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.764937] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc5f2206-7e23-4c96-a6af-82ad12636a35',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.896788] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.267614] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.268035] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.268092] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.268392] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.268537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.268688] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port fc5f2206-7e23-4c96-a6af-82ad12636a35 not found, creating... [ 899.268955] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.270138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.270138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.270138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.270138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.270138] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.270138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.270376] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.270526] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.270653] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.270784] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: fc5f2206-7e23-4c96-a6af-82ad12636a35 is going to be created. [ 899.292156] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.292384] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.292505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.292796] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.293075] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.293305] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.403033] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.904274] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.904445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.904491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.904714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.904808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.904979] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 899.931935] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.932099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.932172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.932376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.932578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.943116] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 900.018533] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-683ca800-6e22-4d54-bd3e-f30dd4d635c2 service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 900.020153] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-683ca800-6e22-4d54-bd3e-f30dd4d635c2 service nova] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 900.020153] env[65107]: INFO networking_nsxv3.common.synchronization [req-5b980063-7450-47a1-999d-4d16b5dae200 req-683ca800-6e22-4d54-bd3e-f30dd4d635c2 service nova] Enqueued Resource ID: fc5f2206-7e23-4c96-a6af-82ad12636a35 with Priority: HIGHEST for action port [ 900.020153] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_rules [ 900.020153] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 900.020153] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5f2206-7e23-4c96-a6af-82ad12636a35 with Priority: HIGHEST for action port [ 900.020444] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.020700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.021080] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.021258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.021523] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc5f2206-7e23-4c96-a6af-82ad12636a35 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.021808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.021980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.022276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.022517] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc5f2206-7e23-4c96-a6af-82ad12636a35',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.528203] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc5f2206-7e23-4c96-a6af-82ad12636a35 with status ACTIVE [ 900.528203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.528203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.528203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.528203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.528203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.528828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.529402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.529402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.529519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.529617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.529932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.530497] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.530591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.530871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.531041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.531093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc5f2206-7e23-4c96-a6af-82ad12636a35 is going to be updated. [ 900.554520] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.554520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.554520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.554951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.554951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.555034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc5f2206-7e23-4c96-a6af-82ad12636a35" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.614310] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 in Status: SUCCESS [ 900.614542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.955650] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 901.956043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.956043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.956214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.956454] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.956604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.956674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.956796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.956884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.956966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.957086] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.957947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.958161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.958341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.958463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.958682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.958768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.958821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.958915] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.462437] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.462596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.462818] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.877921] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ed582f2-f96e-4e21-8f99-ecd20852e42a req-03bc2934-5310-4196-b095-2ce2d606b773 tempest-ServerAddressesTestJSON-109016131 tempest-ServerAddressesTestJSON-109016131-project-member] Enqueued Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_members [ 902.878510] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_members [ 902.878832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72cb83d-eebb-4f22-9614-47f9c3d37d79 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.879154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.879664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.879963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.880152] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.880299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.880347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.880463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.880549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.880643] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.966550] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.227460] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.227460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-766" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.227460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-766" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.227460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-766" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.227886] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.228267] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.231765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.231765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.231765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.231765] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.231765] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.231765] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.231765] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.231765] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.231765] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.231765] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.252130] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.252920] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.253270] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.253609] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-766" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.254128] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-10063b80-a089-4265-b44c-4fe4f1df5a2f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.254570] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.254825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.255321] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.255665] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10063b80-a089-4265-b44c-4fe4f1df5a2f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.383071] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.383241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.383329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.385530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.385530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.385530] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.385530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.385530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.385530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.385530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.385530] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 already deleted. [ 903.385530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.467637] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.467802] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.467876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.468106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.468206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.468310] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 903.497716] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.497858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.497925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.498159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.498305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.508466] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 903.738939] env[65107]: INFO networking_nsxv3.common.synchronization [req-24be60f5-768e-4ec4-9c57-483beac0fce9 req-23c30ca4-6fcb-4ead-b5fe-17c588ca250e tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 903.739487] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 903.739832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.740013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.740125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.740339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.740506] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.740609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.740673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.740836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.740949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.741063] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.760272] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.760425] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.760520] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.761639] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.761964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.762175] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 10063b80-a089-4265-b44c-4fe4f1df5a2f not found, creating... [ 903.762482] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.762959] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.762959] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.763100] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.763256] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.763655] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.763845] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.763983] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.764326] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.764526] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.764683] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 10063b80-a089-4265-b44c-4fe4f1df5a2f is going to be created. [ 903.789874] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.790168] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.790375] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.790946] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.790946] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.791130] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.243636] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.497857] env[65107]: INFO networking_nsxv3.common.synchronization [req-6453c650-78ee-47eb-ba00-d3e91cfa0b45 req-b4b6558d-ea14-4b9f-b80b-6aacfa78325c tempest-ServerGroupTestJSON-208493729 tempest-ServerGroupTestJSON-208493729-project-member] Enqueued Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_members [ 904.498827] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGHEST for action security_group_members [ 904.498929] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.498987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.499119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.499308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.499491] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.499602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.499682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.499946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.500055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.500174] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.518068] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ed582f2-f96e-4e21-8f99-ecd20852e42a req-7607a2a1-7769-42b1-935e-5ca10020f851 service nova] Enqueued Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_rules [ 904.518252] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ed582f2-f96e-4e21-8f99-ecd20852e42a req-7607a2a1-7769-42b1-935e-5ca10020f851 service nova] Enqueued Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_members [ 904.518386] env[65107]: INFO networking_nsxv3.common.synchronization [req-7ed582f2-f96e-4e21-8f99-ecd20852e42a req-7607a2a1-7769-42b1-935e-5ca10020f851 service nova] Enqueued Resource ID: 10063b80-a089-4265-b44c-4fe4f1df5a2f with Priority: HIGHEST for action port [ 904.519318] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_rules [ 904.519646] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_members [ 904.519646] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10063b80-a089-4265-b44c-4fe4f1df5a2f with Priority: HIGHEST for action port [ 904.521182] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b72cb83d-eebb-4f22-9614-47f9c3d37d79 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.522058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.522121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.522400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.522490] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.523598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72cb83d-eebb-4f22-9614-47f9c3d37d79 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.523718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.523791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.523956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.524216] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.524216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.524315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.524421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.524505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.524597] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.525762] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-10063b80-a089-4265-b44c-4fe4f1df5a2f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.525857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.526523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.526523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.526523] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10063b80-a089-4265-b44c-4fe4f1df5a2f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.747504] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.003041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.003282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.003453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.003683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.003806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.004044] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.004187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.004249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.004450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.004497] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.004591] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 is going to be updated. [ 905.029374] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10063b80-a089-4265-b44c-4fe4f1df5a2f with status ACTIVE [ 905.029612] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.029751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.029834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.030079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.030184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.031252] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.031252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.031252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.031252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.031252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.031252] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.031252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.031816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.032189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.032287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.032380] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10063b80-a089-4265-b44c-4fe4f1df5a2f is going to be updated. [ 905.033782] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.034835] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72cb83d-eebb-4f22-9614-47f9c3d37d79 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.034950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.037332] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.037441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.037441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.037876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.037876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.048404] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 in Status: IN_PROGRESS for 2s [ 905.061393] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.061602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.061602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.061881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.062029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.062208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10063b80-a089-4265-b44c-4fe4f1df5a2f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.250973] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.250973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.251342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.251373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.251525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.251660] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 905.286153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.286153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.286153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.286401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.286501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.299288] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 905.519490] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 905.519699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.519948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.520258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.520509] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.520633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.520717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.520881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.520998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.521078] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.536124] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.023361] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.039917] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.040165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.040263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.040556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.040685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.040816] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 is going to be created. [ 906.069821] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.069998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.070067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.070252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.070418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.086256] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 in Status: UNINITIALIZED for 2s [ 906.526547] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.032244] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.032543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.032615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.032823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.032934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.033067] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 907.058896] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 in Status: SUCCESS [ 907.059099] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 deletion is rescheduled due to dependency. [ 907.059261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.071271] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.071551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.071551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.071678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.071827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.082988] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 907.309208] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 907.309544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.350857] env[65107]: INFO networking_nsxv3.common.synchronization [req-2099b7e2-1a2e-441e-889a-f74889b42065 req-d5e0abf2-ffe8-4a73-82a6-f8990badf4c0 tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 907.351482] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 907.352163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.352163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.352163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.352370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.352676] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.352676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.352676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.352811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.352854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.352973] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.855560] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.855905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.855905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.856213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.856213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.856296] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.856397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.856458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.856608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.856690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.856773] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 907.898820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.899013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.899072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.899295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.899434] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.911248] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 908.098475] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 in Status: SUCCESS [ 908.098727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.098885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.099127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.099326] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.099443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.099504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.099689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.099819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.100063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.100213] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.602411] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72cb83d-eebb-4f22-9614-47f9c3d37d79 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.602559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.602625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.602854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.603438] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.603438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.603438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.603438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.603648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.603648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.603700] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72cb83d-eebb-4f22-9614-47f9c3d37d79 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.603789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.603841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.603979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.604134] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.604227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.604288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.604423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.604499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.604596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.604708] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.093442] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 909.093820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.093820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.093980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.094189] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.094337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.094406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.094570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.094651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.094740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.094899] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.094995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.095072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.095211] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.095351] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.095444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.095504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.095636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.095709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.095786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.095874] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.106578] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b72cb83d-eebb-4f22-9614-47f9c3d37d79: rpc.has_security_group_logging(os_id): False [ 909.123891] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.124039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.124155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.124598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.124716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.124939] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.125068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.125132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.125306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.125386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.125592] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.125692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.125747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.125889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.125962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.126177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.126270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.126323] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.126464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.126536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.126618] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 is going to be created. [ 909.185652] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.185808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.186357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.186357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.186357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.195873] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 in Status: IN_PROGRESS for 2s [ 909.598793] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3c6061-32c5-4c10-8da4-b1be3cb71a03: rpc.has_security_group_logging(os_id): False [ 909.618732] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.620083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.620083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.620083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.620083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.620083] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.620083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.620368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.620368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.620368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.620551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.620642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.620714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.620925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.621039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.621352] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.621352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.621427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.621600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.621675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.621807] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 909.715040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.715300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.715347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.715586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.715771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.740474] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 909.921391] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 909.921646] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 deletion is rescheduled due to dependency. [ 909.921807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.210714] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 in Status: SUCCESS [ 911.211136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.761022] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 911.761022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.761022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.761022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.761022] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.767935] env[65107]: INFO networking_nsxv3.common.synchronization [req-491b9d4b-f8c2-4a81-81dd-0712b822feac req-45921904-f772-4175-b144-a8fa05a39ce0 tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 911.768748] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 911.769514] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.769663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.769755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.770658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.770658] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.770658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.770658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.770658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.770870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.770870] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.916695] env[65107]: INFO networking_nsxv3.common.synchronization [req-fee490e3-eae2-4d65-994e-976e2cd3b1c1 req-42849c6f-56e4-4d90-a44e-3956c8888956 tempest-MultipleCreateTestJSON-1524050442 tempest-MultipleCreateTestJSON-1524050442-project-member] Enqueued Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 911.917468] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 with Priority: HIGHEST for action security_group_members [ 911.917793] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.917899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.263372] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.263372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.272096] env[65107]: INFO networking_nsxv3.common.synchronization [req-7bc5e1d8-cb62-4fcd-8525-7ddabd9ead23 req-71325ba1-6cec-4bba-a161-680fbd35ebe4 tempest-MigrationsAdminTest-1967309458 tempest-MigrationsAdminTest-1967309458-project-member] Enqueued Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 912.272096] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4197bdde-e214-41a5-8235-df774396919e with Priority: HIGHEST for action security_group_members [ 912.272096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4197bdde-e214-41a5-8235-df774396919e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.272096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.272944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.273623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.273918] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.274609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.274609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.274609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.275127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.275753] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4197bdde-e214-41a5-8235-df774396919e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.277098] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.780020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.780218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.780353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.780649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.781028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.781096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.781338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.781338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.781485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.781485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.781569] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4197bdde-e214-41a5-8235-df774396919e is going to be updated. [ 912.782731] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.817706] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.817706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.817706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.817706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.817706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.827411] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: IN_PROGRESS for 2s [ 913.285965] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.286329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.286329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.286391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.286455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.286556] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 913.320997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.321200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.321200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.321397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.321552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.362044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 914.220940] env[65107]: INFO networking_nsxv3.common.synchronization [req-fcea1ccd-9035-40a1-a3f5-43679d466700 req-cedbc0b4-9a13-448f-90b5-c86b7dd0122b tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_members [ 914.220940] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_members [ 914.221348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c1ee26-a734-444a-b046-00bdd1cd350d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.221508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.221577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.221835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.222065] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.222192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.222259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.222459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.222603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.222740] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.680105] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.680480] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.680480] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.680679] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.681047] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.681171] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.681228] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.681842] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.681842] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.681842] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.682057] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.682057] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.682158] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.682292] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.682399] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.682532] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.706307] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.706495] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 914.707288] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.707288] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.707288] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-9ca3f751-c48f-49a8-8a38-94f4450ec0df taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.707288] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.707527] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.707747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.707889] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ca3f751-c48f-49a8-8a38-94f4450ec0df',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.725614] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.725787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.725787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.725996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.726104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.726304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.726444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.726535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.726692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.726769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.726853] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c1ee26-a734-444a-b046-00bdd1cd350d already deleted. [ 914.726933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.846343] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4197bdde-e214-41a5-8235-df774396919e in Status: SUCCESS [ 914.846563] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4197bdde-e214-41a5-8235-df774396919e deletion is rescheduled due to dependency. [ 914.846700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4197bdde-e214-41a5-8235-df774396919e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.211354] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.211622] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.211744] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.212087] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.212258] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.212468] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 9ca3f751-c48f-49a8-8a38-94f4450ec0df not found, creating... [ 915.212804] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.212976] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.213209] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.213501] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.213668] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.213957] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.214204] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.214331] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.214676] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.214835] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.215228] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 9ca3f751-c48f-49a8-8a38-94f4450ec0df is going to be created. [ 915.239345] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.239701] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.239701] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.240079] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.240325] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.240549] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.450290] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 915.450733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.451076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.451414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.451739] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.451926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.452227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.452578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.452774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.452989] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.744671] env[65107]: INFO networking_nsxv3.common.synchronization [req-88b2691e-fb00-4aa0-ab3c-1ea1c5141786 req-c72f3677-ca95-45fb-9024-8144b83fd961 tempest-ServerAddressesTestJSON-109016131 tempest-ServerAddressesTestJSON-109016131-project-member] Enqueued Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_members [ 915.745624] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 with Priority: HIGHEST for action security_group_members [ 915.745624] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b72cb83d-eebb-4f22-9614-47f9c3d37d79 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.745797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.745797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.745983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.746156] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.746256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.746318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.746476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.746601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.746699] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b72cb83d-eebb-4f22-9614-47f9c3d37d79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.952120] env[65107]: INFO networking_nsxv3.common.synchronization [req-fcea1ccd-9035-40a1-a3f5-43679d466700 req-d25449e5-3e85-437f-bb97-6fef9c417b64 service nova] Enqueued Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_rules [ 915.952348] env[65107]: INFO networking_nsxv3.common.synchronization [req-fcea1ccd-9035-40a1-a3f5-43679d466700 req-d25449e5-3e85-437f-bb97-6fef9c417b64 service nova] Enqueued Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_members [ 915.952492] env[65107]: INFO networking_nsxv3.common.synchronization [req-fcea1ccd-9035-40a1-a3f5-43679d466700 req-d25449e5-3e85-437f-bb97-6fef9c417b64 service nova] Enqueued Resource ID: 9ca3f751-c48f-49a8-8a38-94f4450ec0df with Priority: HIGHEST for action port [ 915.953241] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_rules [ 915.953447] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_members [ 915.953600] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca3f751-c48f-49a8-8a38-94f4450ec0df with Priority: HIGHEST for action port [ 915.953973] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65c1ee26-a734-444a-b046-00bdd1cd350d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.954180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.954289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.954647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.954707] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.955910] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c1ee26-a734-444a-b046-00bdd1cd350d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.955910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.956015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.956639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.956639] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.956639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.956639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.956877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.957032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.957899] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.958564] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ca3f751-c48f-49a8-8a38-94f4450ec0df taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.959189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.959189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.959189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.959395] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ca3f751-c48f-49a8-8a38-94f4450ec0df',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.963231] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.963231] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.963231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.963231] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 915.993266] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.993548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.993673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.993971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.994195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.005668] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 916.253111] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.253111] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.253111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.253111] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 is going to be updated. [ 916.285444] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.285561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.285561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.285768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.285908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.297503] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 in Status: IN_PROGRESS for 2s [ 916.461384] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c1ee26-a734-444a-b046-00bdd1cd350d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.461544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.461772] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.464920] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ca3f751-c48f-49a8-8a38-94f4450ec0df with status ACTIVE [ 916.464920] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.465115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.465115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.465271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.465381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.465575] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.465687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.465749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.465926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.466028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.466218] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.466314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.466390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.466532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.466838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.466838] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ca3f751-c48f-49a8-8a38-94f4450ec0df is going to be updated. [ 916.494060] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.494060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.494060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.494522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.494522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.494727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ca3f751-c48f-49a8-8a38-94f4450ec0df" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.964530] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.468850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.469075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.469129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.469376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.469474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.469589] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c1ee26-a734-444a-b046-00bdd1cd350d is going to be created. [ 917.493965] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.494220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.494220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.494491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.494673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.506384] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c1ee26-a734-444a-b046-00bdd1cd350d in Status: UNINITIALIZED for 2s [ 918.020422] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 918.020738] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 deletion is rescheduled due to dependency. [ 918.020944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.021210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.021511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.022307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.022307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.022307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.022307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.022535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.022535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.022599] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.313571] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 in Status: SUCCESS [ 918.314035] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b72cb83d-eebb-4f22-9614-47f9c3d37d79 deletion is rescheduled due to dependency. [ 918.314394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b72cb83d-eebb-4f22-9614-47f9c3d37d79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.528858] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.529120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.529120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.529402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.529520] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.529647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.529761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.530040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.530317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.530418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.530586] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.530833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.530833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.530967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.531036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.531135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.531582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.531582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.531680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.531721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.531812] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3c6061-32c5-4c10-8da4-b1be3cb71a03',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.978919] env[65107]: INFO networking_nsxv3.common.synchronization [None req-89c8e6dc-5f65-4559-b891-1c172012f5eb None None] Enqueued Resource ID: 4da39db7-4e4c-42be-a2d8-55a85ef7a05b with Priority: HIGHEST for action port [ 918.979365] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da39db7-4e4c-42be-a2d8-55a85ef7a05b with Priority: HIGHEST for action port [ 918.979734] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4da39db7-4e4c-42be-a2d8-55a85ef7a05b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.979904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4da39db7-4e4c-42be-a2d8-55a85ef7a05b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.980021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4da39db7-4e4c-42be-a2d8-55a85ef7a05b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.980546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4da39db7-4e4c-42be-a2d8-55a85ef7a05b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.980732] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da39db7-4e4c-42be-a2d8-55a85ef7a05b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.034974] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3c6061-32c5-4c10-8da4-b1be3cb71a03: rpc.has_security_group_logging(os_id): False [ 919.058639] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.058891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.058891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.059143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.059293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.059601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.059719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.059786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.060134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.060253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.060453] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.060551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.060708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.060913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.061071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.061268] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.061367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.061430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.061607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.061688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.061805] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 is going to be updated. [ 919.158025] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.158025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.158025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.159220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.159220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.178553] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: IN_PROGRESS for 2s [ 919.482704] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4da39db7-4e4c-42be-a2d8-55a85ef7a05b [ 919.482988] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.483232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.483302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.483523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.483622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.483762] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4da39db7-4e4c-42be-a2d8-55a85ef7a05b already deleted. [ 919.483793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4da39db7-4e4c-42be-a2d8-55a85ef7a05b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.517579] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c1ee26-a734-444a-b046-00bdd1cd350d in Status: SUCCESS [ 919.517896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.518124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.518355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.518595] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.518760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.518848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.519048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.519609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.519609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.519609] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.784421] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f29abc89-d5aa-4029-8984-ea5bdc847c3c tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_rules [ 919.786647] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_rules [ 919.787424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcf6500c-0f04-40de-ab53-f85da7100112 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.787424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.787424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.787636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.787636] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.914540] env[65107]: INFO networking_nsxv3.common.synchronization [None req-eb3b2d10-ac38-41f9-836a-3277d920d26c tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_rules [ 919.914540] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_rules [ 919.914540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcf6500c-0f04-40de-ab53-f85da7100112 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.914540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.022204] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.309951] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.309951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.309951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.309951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.309951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.309951] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcf6500c-0f04-40de-ab53-f85da7100112 already deleted. [ 920.309951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.309951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.309951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.309951] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.524422] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65c1ee26-a734-444a-b046-00bdd1cd350d: rpc.has_security_group_logging(os_id): False [ 920.546186] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.546379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.546440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.546653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.546732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.547152] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.547152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.547152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.547307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.547341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.547427] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65c1ee26-a734-444a-b046-00bdd1cd350d is going to be created. [ 920.613355] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.613355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.613355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.614093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.614093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.629472] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65c1ee26-a734-444a-b046-00bdd1cd350d in Status: IN_PROGRESS for 2s [ 920.777682] env[65107]: INFO networking_nsxv3.common.synchronization [req-9f0ecbe8-ba4f-4411-af96-d1f0a7fd3464 req-85fae891-669d-464d-be5f-3f92fda2703b tempest-ServersAdminTestJSON-354927641 tempest-ServersAdminTestJSON-354927641-project-member] Enqueued Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 920.778318] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e6dbc-45c8-476b-af04-082906b1ad4d with Priority: HIGHEST for action security_group_members [ 920.778619] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d43e6dbc-45c8-476b-af04-082906b1ad4d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.778729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.778798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.778994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.779163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.779780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.779780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.779780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.779780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.779780] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d43e6dbc-45c8-476b-af04-082906b1ad4d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.837542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.837756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.837821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.841291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.841291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.841291] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcf6500c-0f04-40de-ab53-f85da7100112 already deleted. [ 920.841291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.197601] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3c6061-32c5-4c10-8da4-b1be3cb71a03 in Status: SUCCESS [ 921.198305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3c6061-32c5-4c10-8da4-b1be3cb71a03" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.282027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.282933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.282933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.282933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.328933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.331075] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.331075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.331075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.331075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.331075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.331075] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d is going to be updated. [ 921.366304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.366585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.366833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.367172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.367364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.377844] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: IN_PROGRESS for 2s [ 921.503705] env[65107]: INFO networking_nsxv3.common.synchronization [None req-2dcc5925-83e3-4074-8648-766c6e23b292 None None] Enqueued Resource ID: 85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77 with Priority: HIGHEST for action port [ 921.504353] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77 with Priority: HIGHEST for action port [ 921.504771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.504927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.505083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.505422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.505588] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.007598] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77 [ 922.007853] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.007991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.008118] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.008303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.008402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.008497] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77 already deleted. [ 922.008579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c0a95d-7e65-4bd2-96a6-2c1c78ed9e77" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.645263] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65c1ee26-a734-444a-b046-00bdd1cd350d in Status: SUCCESS [ 922.645605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.305482] env[65107]: INFO networking_nsxv3.common.synchronization [req-9768587f-e54b-4759-bec0-4e8b26c1041d req-9d1e153c-fd90-430a-8676-73a50e947cd2 tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 923.306043] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 923.306361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.306479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.306544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.306732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.306875] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.306968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.307039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.307181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.307264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.307374] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.388959] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d43e6dbc-45c8-476b-af04-082906b1ad4d in Status: SUCCESS [ 923.389084] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d43e6dbc-45c8-476b-af04-082906b1ad4d deletion is rescheduled due to dependency. [ 923.389247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d43e6dbc-45c8-476b-af04-082906b1ad4d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.730545] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.730917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.730917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.731151] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.731411] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.731568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.731683] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.731893] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.732047] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.732298] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.732408] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.732517] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.732619] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.732727] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.732830] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.732961] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.751726] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.751879] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.752023] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.752258] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-69" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.752580] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.752755] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.752874] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.753206] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.753341] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8ff2218-cca6-45c2-ae46-dec74d5ce98e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.811228] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.811381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.811460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.811687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.811782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.812078] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.812252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.812327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.812490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.812581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.812668] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 923.838934] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.839199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.839287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.839625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.839810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.848725] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 924.255408] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.255631] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.255765] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.256924] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.256924] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.256924] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port b8ff2218-cca6-45c2-ae46-dec74d5ce98e not found, creating... [ 924.256924] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.258728] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.258728] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.258728] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: b8ff2218-cca6-45c2-ae46-dec74d5ce98e is going to be created. [ 924.279499] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.279607] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.279743] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.279947] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.280203] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.280426] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.018201] env[65107]: INFO networking_nsxv3.common.synchronization [req-9768587f-e54b-4759-bec0-4e8b26c1041d req-3d11a92c-b1c9-4ab4-8f5d-e5d3dbc0b10e service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 925.018201] env[65107]: INFO networking_nsxv3.common.synchronization [req-9768587f-e54b-4759-bec0-4e8b26c1041d req-3d11a92c-b1c9-4ab4-8f5d-e5d3dbc0b10e service nova] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 925.018201] env[65107]: INFO networking_nsxv3.common.synchronization [req-9768587f-e54b-4759-bec0-4e8b26c1041d req-3d11a92c-b1c9-4ab4-8f5d-e5d3dbc0b10e service nova] Enqueued Resource ID: b8ff2218-cca6-45c2-ae46-dec74d5ce98e with Priority: HIGHEST for action port [ 925.018201] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_rules [ 925.018201] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 925.018201] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ff2218-cca6-45c2-ae46-dec74d5ce98e with Priority: HIGHEST for action port [ 925.018834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.019154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.019314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.019614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.019780] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.020947] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.021248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.021727] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.021952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.022275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.022553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.022745] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8ff2218-cca6-45c2-ae46-dec74d5ce98e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.528144] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.528297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.528471] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8ff2218-cca6-45c2-ae46-dec74d5ce98e with status ACTIVE [ 925.528644] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.528750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.528814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.529044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.529136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.529310] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.529420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.529481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.529871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.529871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.529871] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.530137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.530137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.530137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.530319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.530319] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8ff2218-cca6-45c2-ae46-dec74d5ce98e is going to be updated. [ 925.556645] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.556786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.558422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.558422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.558422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.558422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8ff2218-cca6-45c2-ae46-dec74d5ce98e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.860700] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 925.860700] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 deletion is rescheduled due to dependency. [ 925.860700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.860700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.860700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.860700] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.860700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.860700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.860700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.860700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.860700] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.076836] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f8a8359c-f697-45c9-8431-4f96c90e5819 None None] Enqueued Resource ID: 5d830db1-31af-4f79-a220-2e4d33c18179 with Priority: HIGHEST for action port [ 926.082683] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d830db1-31af-4f79-a220-2e4d33c18179 with Priority: HIGHEST for action port [ 926.083058] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d830db1-31af-4f79-a220-2e4d33c18179 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.083368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d830db1-31af-4f79-a220-2e4d33c18179" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.083368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d830db1-31af-4f79-a220-2e4d33c18179" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.083526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d830db1-31af-4f79-a220-2e4d33c18179" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.083610] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d830db1-31af-4f79-a220-2e4d33c18179',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.363890] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.588034] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d830db1-31af-4f79-a220-2e4d33c18179 [ 926.588286] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.588498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.588565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.588771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.588857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.589228] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d830db1-31af-4f79-a220-2e4d33c18179 already deleted. [ 926.589228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d830db1-31af-4f79-a220-2e4d33c18179" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.868185] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.376087] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.376087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.376087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.376706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.376706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.376706] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 927.415484] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.415484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.415484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.415484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.415484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.430898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 929.036130] env[65107]: INFO networking_nsxv3.common.synchronization [None req-bdba3f18-311b-45a2-8040-a201b28a5f43 None None] Enqueued Resource ID: e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6 with Priority: HIGHEST for action port [ 929.036130] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6 with Priority: HIGHEST for action port [ 929.036130] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.036130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.042669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.042669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.042669] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.444829] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 929.445226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.445442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.445720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.445998] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.446147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.446215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.446434] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.446544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.446642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.446769] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.544200] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6 [ 929.544200] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.544324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.544424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.544612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.544704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.544800] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6 already deleted. [ 929.544883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0259ca4-4ae0-4eb6-aa3e-69cdef4dacc6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.749972] env[65107]: INFO networking_nsxv3.common.synchronization [req-a187e50f-a5b4-4bc6-a627-643c5002f029 req-1e5f010e-2647-4e72-bb4d-7fef50b0efb1 tempest-ServersTestBootFromVolume-1621330954 tempest-ServersTestBootFromVolume-1621330954-project-member] Enqueued Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_members [ 929.750598] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGHEST for action security_group_members [ 929.750909] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.751062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.751141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.751339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.751522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.751592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.751651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.751879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.751965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.752116] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.950457] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.950457] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.950457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.950457] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.951270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.951439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.951659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.951904] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.952079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.952167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.952387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.952576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.952717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.953289] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.256313] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.256618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.256618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.258029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.258029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.258029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.258029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.258029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.258492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.258492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.258492] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 is going to be updated. [ 930.294175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.294175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.294175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.294536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.294536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.306030] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8339c2c0-4975-4589-90b6-20ecd3100845 in Status: IN_PROGRESS for 2s [ 930.457575] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57ccc978-a1f0-4c03-8296-5acfbdaf68e4: rpc.has_security_group_logging(os_id): False [ 930.479198] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.480049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.480049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.480049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.480049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.480265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.480265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.480355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.480455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.480533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.480780] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.480836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.480836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.481064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.481097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.481276] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.481368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.481429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.484142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.484274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.484406] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 930.559461] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.559656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.559763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.559930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.560125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.574665] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 932.319353] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8339c2c0-4975-4589-90b6-20ecd3100845 in Status: SUCCESS [ 932.319353] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 deletion is rescheduled due to dependency. [ 932.319353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.593024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 932.593419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.751777] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 934.752127] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 937.878664] env[65107]: INFO networking_nsxv3.common.synchronization [None req-494cff0c-7fb3-45c5-a8a2-5aad273de224 None None] Enqueued Resource ID: fe215a2b-743c-477a-b853-ed6204369197 with Priority: HIGHEST for action port [ 937.879236] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe215a2b-743c-477a-b853-ed6204369197 with Priority: HIGHEST for action port [ 937.881242] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe215a2b-743c-477a-b853-ed6204369197 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.881242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe215a2b-743c-477a-b853-ed6204369197" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.881242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe215a2b-743c-477a-b853-ed6204369197" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.881242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe215a2b-743c-477a-b853-ed6204369197" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.881483] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe215a2b-743c-477a-b853-ed6204369197',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.384929] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe215a2b-743c-477a-b853-ed6204369197 [ 938.385169] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.385307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.385376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.385587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.385680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.385773] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe215a2b-743c-477a-b853-ed6204369197 already deleted. [ 938.385852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe215a2b-743c-477a-b853-ed6204369197" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.740308] env[65107]: INFO networking_nsxv3.common.synchronization [req-88c9877f-42db-4ff6-bd05-4600e0b69f6d req-4aa28912-2be6-4b0e-8501-e866e2afa8ba tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_members [ 938.740894] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_members [ 938.741254] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcf6500c-0f04-40de-ab53-f85da7100112 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.741380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.741439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.741722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.741885] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.741998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.742125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.742886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.742886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.742886] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.245580] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.245981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.245981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.246067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.246146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.247769] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.247938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.248039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.248249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.248668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.248797] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcf6500c-0f04-40de-ab53-f85da7100112 already deleted. [ 939.248936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.297279] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.297476] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.297614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.298232] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.298232] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.298505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.298505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.298685] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.298827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.299723] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.299849] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.300116] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.300261] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.300344] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.300476] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.300614] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.322603] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.322812] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 939.322956] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.323161] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.323708] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-969d9fb7-15bf-4274-baf0-66342b8f544f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.323972] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.324117] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.324450] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.324591] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('969d9fb7-15bf-4274-baf0-66342b8f544f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.828233] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.828623] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.828842] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.829202] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.829355] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.829511] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 969d9fb7-15bf-4274-baf0-66342b8f544f not found, creating... [ 939.829964] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.829964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.830103] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.830325] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.830494] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.830792] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.830981] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.831113] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.831321] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.831450] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.831589] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 969d9fb7-15bf-4274-baf0-66342b8f544f is going to be created. [ 939.853817] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.853975] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.854124] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.854511] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.854772] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.855103] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.881348] env[65107]: INFO networking_nsxv3.common.synchronization [None req-8c66bd1e-1a64-43ae-bf39-da14183bdafd None None] Enqueued Resource ID: 2cee7378-8a84-42b1-8146-471d8008e75a with Priority: HIGHEST for action port [ 939.881348] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cee7378-8a84-42b1-8146-471d8008e75a with Priority: HIGHEST for action port [ 939.881348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cee7378-8a84-42b1-8146-471d8008e75a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.883322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cee7378-8a84-42b1-8146-471d8008e75a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.883449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cee7378-8a84-42b1-8146-471d8008e75a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.884074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cee7378-8a84-42b1-8146-471d8008e75a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.884181] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cee7378-8a84-42b1-8146-471d8008e75a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.185757] env[65107]: INFO networking_nsxv3.common.synchronization [None req-9469131d-decf-43d0-ac4b-934680029387 tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 940.185757] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 940.186021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.186149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.186206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.186478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.186545] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.386961] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cee7378-8a84-42b1-8146-471d8008e75a [ 940.387428] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.387428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.387428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.387712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.387712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.387821] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cee7378-8a84-42b1-8146-471d8008e75a already deleted. [ 940.387925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cee7378-8a84-42b1-8146-471d8008e75a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.442270] env[65107]: INFO networking_nsxv3.common.synchronization [None req-fcd9783d-2c0b-4fdf-8cfc-61fad21584a9 tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 940.442751] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 940.443161] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.443565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.660445] env[65107]: INFO networking_nsxv3.common.synchronization [req-88c9877f-42db-4ff6-bd05-4600e0b69f6d req-b7e85d67-641a-458e-a61d-691b45bcc917 service nova] Enqueued Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_rules [ 940.660445] env[65107]: INFO networking_nsxv3.common.synchronization [req-88c9877f-42db-4ff6-bd05-4600e0b69f6d req-b7e85d67-641a-458e-a61d-691b45bcc917 service nova] Enqueued Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_members [ 940.660445] env[65107]: INFO networking_nsxv3.common.synchronization [req-88c9877f-42db-4ff6-bd05-4600e0b69f6d req-b7e85d67-641a-458e-a61d-691b45bcc917 service nova] Enqueued Resource ID: 969d9fb7-15bf-4274-baf0-66342b8f544f with Priority: HIGHEST for action port [ 940.661571] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_rules [ 940.661571] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_members [ 940.661571] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 969d9fb7-15bf-4274-baf0-66342b8f544f with Priority: HIGHEST for action port [ 940.663084] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcf6500c-0f04-40de-ab53-f85da7100112 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.663084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.663084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.663084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.663084] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.664467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcf6500c-0f04-40de-ab53-f85da7100112 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.666517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.666517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.666517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.666517] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.666517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.666517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.666926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.666926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.666986] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.668788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-969d9fb7-15bf-4274-baf0-66342b8f544f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.668788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.668788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.668788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.669098] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('969d9fb7-15bf-4274-baf0-66342b8f544f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.709210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.709406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.709457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.709650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.710157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.710157] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e already deleted. [ 940.710157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.710381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.710381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.710461] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.171828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcf6500c-0f04-40de-ab53-f85da7100112 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.172045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.172361] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.173318] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 969d9fb7-15bf-4274-baf0-66342b8f544f with status ACTIVE [ 941.173496] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.173628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.173714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.173932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.175556] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.175556] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.175556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.176054] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 969d9fb7-15bf-4274-baf0-66342b8f544f is going to be updated. [ 941.197974] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.198172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.198218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.199020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.199020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.199020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-969d9fb7-15bf-4274-baf0-66342b8f544f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.232306] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.232613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.232613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.232820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.233089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.233089] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e already deleted. [ 941.233089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.678322] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.182864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.183068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.183204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.183486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.183628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.183684] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcf6500c-0f04-40de-ab53-f85da7100112 is going to be created. [ 942.210956] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.211183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.211183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.211380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.211727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.223310] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcf6500c-0f04-40de-ab53-f85da7100112 in Status: UNINITIALIZED for 2s [ 943.690988] env[65107]: INFO networking_nsxv3.common.synchronization [req-c520bfef-474e-401c-b0b5-afb64ed15365 req-0df5fbe2-76dd-457a-ba59-85c7cc470a23 tempest-ServerPasswordTestJSON-123963008 tempest-ServerPasswordTestJSON-123963008-project-member] Enqueued Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_members [ 943.691288] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_members [ 943.691572] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.692140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.692246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.692638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.693045] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.693045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.693228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.693584] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.693584] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.693680] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.069062] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-417 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.070540] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-417" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.070540] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-417" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.070540] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-417" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.070540] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.073061] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.073061] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.073061] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.073061] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.073061] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.073061] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.073061] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.073061] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.073061] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.073061] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.073463] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.093822] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.094009] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.094536] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.094536] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-417" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.094637] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.094843] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.094912] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.095277] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.095419] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1bb7a58-a605-4fae-bc32-dc23fda1a0ba',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.196078] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.196252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.196324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.196593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.196678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.196924] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.197044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.197110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.197270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.197358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.197449] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9937f05f-124d-494a-801f-dac861864434 already deleted. [ 944.197575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.234349] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcf6500c-0f04-40de-ab53-f85da7100112 in Status: SUCCESS [ 944.234680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.234850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.235074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.235269] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.235388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.235452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.235645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.235730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.235815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.235906] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.598852] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.600414] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.600414] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.600986] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.600986] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.600986] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port b1bb7a58-a605-4fae-bc32-dc23fda1a0ba not found, creating... [ 944.603219] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.603417] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.603615] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.603931] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.604493] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.604493] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.604646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.604819] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.605140] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.605778] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.605778] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: b1bb7a58-a605-4fae-bc32-dc23fda1a0ba is going to be created. [ 944.629738] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.629954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.630135] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.630440] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.630705] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.630952] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.740072] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.242756] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcf6500c-0f04-40de-ab53-f85da7100112: rpc.has_security_group_logging(os_id): False [ 945.261547] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.262234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.262234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.262234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.262234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.262468] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.262610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.262677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.262845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.263081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.263081] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcf6500c-0f04-40de-ab53-f85da7100112 is going to be created. [ 945.277278] env[65107]: INFO networking_nsxv3.common.synchronization [None req-81644f08-b11b-46c6-a42b-94b0f32a4683 None None] Enqueued Resource ID: ae11fcd2-5b65-48cb-958b-bc911a4d2a93 with Priority: HIGHEST for action port [ 945.277821] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae11fcd2-5b65-48cb-958b-bc911a4d2a93 with Priority: HIGHEST for action port [ 945.278147] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae11fcd2-5b65-48cb-958b-bc911a4d2a93 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.278310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae11fcd2-5b65-48cb-958b-bc911a4d2a93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.278362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae11fcd2-5b65-48cb-958b-bc911a4d2a93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.278587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae11fcd2-5b65-48cb-958b-bc911a4d2a93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.278884] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae11fcd2-5b65-48cb-958b-bc911a4d2a93',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.342750] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.342944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.342976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.343204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.343384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.351200] env[65107]: INFO networking_nsxv3.common.synchronization [req-c520bfef-474e-401c-b0b5-afb64ed15365 req-3059a5ca-96fb-493b-88f7-e9d4a9088097 service nova] Enqueued Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_rules [ 945.351383] env[65107]: INFO networking_nsxv3.common.synchronization [req-c520bfef-474e-401c-b0b5-afb64ed15365 req-3059a5ca-96fb-493b-88f7-e9d4a9088097 service nova] Enqueued Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_members [ 945.351520] env[65107]: INFO networking_nsxv3.common.synchronization [req-c520bfef-474e-401c-b0b5-afb64ed15365 req-3059a5ca-96fb-493b-88f7-e9d4a9088097 service nova] Enqueued Resource ID: b1bb7a58-a605-4fae-bc32-dc23fda1a0ba with Priority: HIGHEST for action port [ 945.352030] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_rules [ 945.352170] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_members [ 945.352266] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1bb7a58-a605-4fae-bc32-dc23fda1a0ba with Priority: HIGHEST for action port [ 945.352573] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.352709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.352860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.353244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.353330] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.354197] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.354309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.354405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.354854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.354854] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.354854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.354854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.355261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.355261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.355261] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.355949] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.355949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.356141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.356141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.356239] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1bb7a58-a605-4fae-bc32-dc23fda1a0ba',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.360679] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcf6500c-0f04-40de-ab53-f85da7100112 in Status: IN_PROGRESS for 2s [ 945.781517] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae11fcd2-5b65-48cb-958b-bc911a4d2a93 [ 945.781830] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.782303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.782303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.782303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.782303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.783025] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae11fcd2-5b65-48cb-958b-bc911a4d2a93 already deleted. [ 945.783025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae11fcd2-5b65-48cb-958b-bc911a4d2a93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.858286] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.858385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.861875] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1bb7a58-a605-4fae-bc32-dc23fda1a0ba with status ACTIVE [ 945.862407] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.862407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.862407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.863377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.863377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.863377] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.863377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.863377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.863377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.863681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.863765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.863920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.863920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.864072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.864209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.864339] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1bb7a58-a605-4fae-bc32-dc23fda1a0ba is going to be updated. [ 945.866376] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.894324] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.894460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.894531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.894751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.894885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.895056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1bb7a58-a605-4fae-bc32-dc23fda1a0ba" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.370068] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.872239] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.874021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.874021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.874021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.874021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.874021] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9937f05f-124d-494a-801f-dac861864434 is going to be created. [ 946.909355] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.909522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.909570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.909781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.909942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.921077] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9937f05f-124d-494a-801f-dac861864434 in Status: UNINITIALIZED for 2s [ 947.393314] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcf6500c-0f04-40de-ab53-f85da7100112 in Status: SUCCESS [ 947.393363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.515356] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a5800f3-2405-412c-b230-05f5694583e9 req-c57b7686-c6e5-49c7-b2da-1a361f798800 tempest-ImagesTestJSON-2116578577 tempest-ImagesTestJSON-2116578577-project-member] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 947.515921] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGHEST for action security_group_members [ 947.517059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.517059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.517059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.517633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.517633] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.517633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.517633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.517633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.518016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.518016] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.795997] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7e7990f6-9a00-49e6-ace1-00d9ed33ba16 None None] Enqueued Resource ID: ddd142ad-3d1c-41cd-b19d-5a5e6717ed93 with Priority: HIGHEST for action port [ 947.796601] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd142ad-3d1c-41cd-b19d-5a5e6717ed93 with Priority: HIGHEST for action port [ 947.796905] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd142ad-3d1c-41cd-b19d-5a5e6717ed93 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.797332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd142ad-3d1c-41cd-b19d-5a5e6717ed93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.797332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd142ad-3d1c-41cd-b19d-5a5e6717ed93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.797445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd142ad-3d1c-41cd-b19d-5a5e6717ed93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.797445] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd142ad-3d1c-41cd-b19d-5a5e6717ed93',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.021039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.021039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.021039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.021039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.021435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.021435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.021521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.021554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.021684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.021766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.021852] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be updated. [ 948.053486] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.053614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.053671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.053867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.054019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.067808] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: IN_PROGRESS for 2s [ 948.300140] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddd142ad-3d1c-41cd-b19d-5a5e6717ed93 [ 948.300395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.300553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.300631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.300895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.300995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.301112] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddd142ad-3d1c-41cd-b19d-5a5e6717ed93 already deleted. [ 948.301195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd142ad-3d1c-41cd-b19d-5a5e6717ed93" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.932245] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9937f05f-124d-494a-801f-dac861864434 in Status: SUCCESS [ 948.932480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.932704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.932920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.933140] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.933278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.933339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.933493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.933589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.933673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.933776] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.436215] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.437140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.437140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.437612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.437612] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.437612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.437612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.438384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.438384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.438384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.438384] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.438384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.438384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.438384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.438767] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.438767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.438767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.438767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.439024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.439024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.439114] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.943170] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9937f05f-124d-494a-801f-dac861864434: rpc.has_security_group_logging(os_id): False [ 949.966851] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.967184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.967184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.967364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.967457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.967947] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.967947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.967947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.968166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.968166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.968278] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.968350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.968400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.968713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.968713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.968854] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.968854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.968976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.969363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.969363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.969363] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9937f05f-124d-494a-801f-dac861864434 is going to be created. [ 950.052445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.052796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.052796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.053082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.053310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.067697] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9937f05f-124d-494a-801f-dac861864434 in Status: IN_PROGRESS for 2s [ 950.081319] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 in Status: SUCCESS [ 950.081552] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 deletion is rescheduled due to dependency. [ 950.082717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.405235] env[65107]: INFO networking_nsxv3.common.synchronization [None req-102a2f5a-8f3c-4fe1-bd71-f4b72433510c tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: d236630b-4b15-46f2-9e25-0be72d77b88c with Priority: HIGHEST for action security_group_rules [ 950.405235] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d236630b-4b15-46f2-9e25-0be72d77b88c with Priority: HIGHEST for action security_group_rules [ 950.405235] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d236630b-4b15-46f2-9e25-0be72d77b88c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.405235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.405235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.405235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.405235] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d236630b-4b15-46f2-9e25-0be72d77b88c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.543325] env[65107]: INFO networking_nsxv3.common.synchronization [None req-6991eb55-c7cb-4b56-aca5-05bb60c7065f tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: d236630b-4b15-46f2-9e25-0be72d77b88c with Priority: HIGHEST for action security_group_rules [ 950.543858] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d236630b-4b15-46f2-9e25-0be72d77b88c with Priority: HIGHEST for action security_group_rules [ 950.544229] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d236630b-4b15-46f2-9e25-0be72d77b88c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.544404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.636313] env[65107]: INFO networking_nsxv3.common.synchronization [req-02c87f40-0f14-4f03-9db8-6b3bebc99c27 req-0d748702-8d9c-4594-b61a-463c6f704a30 tempest-ServersWithSpecificFlavorTestJSON-1770061733 tempest-ServersWithSpecificFlavorTestJSON-1770061733-project-member] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 950.636848] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGHEST for action security_group_members [ 950.637181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.637314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.637398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.637638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.637781] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.637883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.637963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.638150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.638246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.638338] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.940224] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.942021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.942021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.942021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.942021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.942021] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d236630b-4b15-46f2-9e25-0be72d77b88c already deleted. [ 950.942021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.942021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.942021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.942021] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d236630b-4b15-46f2-9e25-0be72d77b88c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.140369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.140640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.140758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.141028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.141161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.141395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.141551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.141635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.141830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.141942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.142093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be updated. [ 951.174815] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.175025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.175125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.175334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.175475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.185476] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: IN_PROGRESS for 2s [ 951.495393] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.495671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.495756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.496279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.496473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.496609] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d236630b-4b15-46f2-9e25-0be72d77b88c already deleted. [ 951.497165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d236630b-4b15-46f2-9e25-0be72d77b88c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.083718] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9937f05f-124d-494a-801f-dac861864434 in Status: SUCCESS [ 952.084041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.192947] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-352 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.193292] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.193605] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.193787] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.194295] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.194536] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.194714] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.195032] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.195312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.195529] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.195700] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.195887] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.196106] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.196462] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.196462] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.196636] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.212326] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5a9e810-a93e-4373-b821-f175316f25f4 in Status: SUCCESS [ 953.212942] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 deletion is rescheduled due to dependency. [ 953.212942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.220268] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.220434] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.220576] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.220829] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-352" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.221451] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-bddde8fd-659f-44ac-99c5-739567bc218e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.221585] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.221752] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.222135] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.222378] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bddde8fd-659f-44ac-99c5-739567bc218e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.294038] env[65107]: INFO networking_nsxv3.common.synchronization [req-713bc8df-89fc-478b-a492-82a8f3f83046 req-456ddef1-0b84-4b5c-96a2-a6096bfb28b6 tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 953.294621] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 953.294944] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.295090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.295159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.295579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.295748] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.295851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.295915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.296088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.296177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.296271] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.725538] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.725747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.725856] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.726203] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.726362] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.726674] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.726893] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.727021] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.727244] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.727375] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.727661] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.727818] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.727943] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.728369] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.728510] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.728646] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: bddde8fd-659f-44ac-99c5-739567bc218e is going to be updated. [ 953.757889] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.758223] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.758373] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.758698] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.758892] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.759136] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.801259] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.801391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.801509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.801858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.802028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.802407] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.802517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.802551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.802826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.802912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.803018] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 953.860320] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.862132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.862132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.862132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.862132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.873386] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 954.477849] env[65107]: INFO networking_nsxv3.common.synchronization [req-fe127fd5-4c83-40d0-b9b9-32ce9d4d9417 req-42cb397e-f3cb-4b0f-9dab-7a15620ad0ce service nova] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_rules [ 954.478128] env[65107]: INFO networking_nsxv3.common.synchronization [req-fe127fd5-4c83-40d0-b9b9-32ce9d4d9417 req-42cb397e-f3cb-4b0f-9dab-7a15620ad0ce service nova] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 954.478128] env[65107]: INFO networking_nsxv3.common.synchronization [req-fe127fd5-4c83-40d0-b9b9-32ce9d4d9417 req-42cb397e-f3cb-4b0f-9dab-7a15620ad0ce service nova] Enqueued Resource ID: bddde8fd-659f-44ac-99c5-739567bc218e with Priority: HIGHEST for action port [ 954.478670] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_rules [ 954.478821] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 954.478930] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bddde8fd-659f-44ac-99c5-739567bc218e with Priority: HIGHEST for action port [ 954.479316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.479403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.479441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.479637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.479718] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.480807] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.480932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.480985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.481192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.481344] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.481439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.481500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.481637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.481723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.481816] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.482996] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-bddde8fd-659f-44ac-99c5-739567bc218e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.482996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.482996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.483335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.483335] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bddde8fd-659f-44ac-99c5-739567bc218e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.985854] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.985854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.986051] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.986929] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bddde8fd-659f-44ac-99c5-739567bc218e with status ACTIVE [ 954.988288] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.988288] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.988288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.988288] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.988823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.988823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.988823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.988823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.988823] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bddde8fd-659f-44ac-99c5-739567bc218e is going to be updated. [ 955.016126] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.016126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.016126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.016575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.016575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bddde8fd-659f-44ac-99c5-739567bc218e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.491240] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.885142] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 955.885448] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 955.885506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.994487] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.994702] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.996856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.996856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.996856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.996856] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be updated. [ 956.031553] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.031820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.031913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.032162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.032367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.046203] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 956.201495] env[65107]: INFO networking_nsxv3.common.synchronization [req-b059564a-6415-4893-8327-50cb8add8874 req-76e6dc73-ca44-43ea-a14c-b26b1562e83d tempest-ListServerFiltersTestJSON-2098391239 tempest-ListServerFiltersTestJSON-2098391239-project-member] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 956.202135] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 956.202569] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.202729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.202828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.203173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.203433] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.203550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.203624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.203882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.203982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.204075] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.584515] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.584880] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.584939] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.586809] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.586809] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.586809] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.586809] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.586809] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.586809] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.586809] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.586809] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.586809] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.587637] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.587637] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.587637] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.587637] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.619936] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.620177] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.620347] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.620532] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.620957] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-48f1230a-fcec-490a-98f5-6b0dfdbc0576 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.621183] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.621305] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.621640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.621778] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f1230a-fcec-490a-98f5-6b0dfdbc0576',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.706321] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.706486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.706486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.706707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.706797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.707039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.707145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.707206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.707358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.707432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.707515] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 already deleted. [ 956.707590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.126102] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.126102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.126102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.126528] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.126528] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.126528] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 48f1230a-fcec-490a-98f5-6b0dfdbc0576 not found, creating... [ 957.126746] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.126901] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.127022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.127262] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.127402] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.127682] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.127831] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.127942] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.128150] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.128275] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.128403] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 48f1230a-fcec-490a-98f5-6b0dfdbc0576 is going to be created. [ 957.149091] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.149321] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.149440] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.150029] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.150113] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.150299] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.460260] env[65107]: INFO networking_nsxv3.common.synchronization [req-017d0520-900a-4459-8f63-a09bb51efab1 req-64354450-bfa6-4d21-ad98-058589791416 tempest-ServerPasswordTestJSON-123963008 tempest-ServerPasswordTestJSON-123963008-project-member] Enqueued Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_members [ 957.461046] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGHEST for action security_group_members [ 957.461996] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.461996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.461996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.461996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.462340] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.462340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.462438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.462946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.462946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.463119] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.918086] env[65107]: INFO networking_nsxv3.common.synchronization [req-b059564a-6415-4893-8327-50cb8add8874 req-cb919ff7-9d9c-405c-a7a7-674edc4c9578 service nova] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_rules [ 957.918086] env[65107]: INFO networking_nsxv3.common.synchronization [req-b059564a-6415-4893-8327-50cb8add8874 req-cb919ff7-9d9c-405c-a7a7-674edc4c9578 service nova] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 957.918086] env[65107]: INFO networking_nsxv3.common.synchronization [req-b059564a-6415-4893-8327-50cb8add8874 req-cb919ff7-9d9c-405c-a7a7-674edc4c9578 service nova] Enqueued Resource ID: 48f1230a-fcec-490a-98f5-6b0dfdbc0576 with Priority: HIGHEST for action port [ 957.918673] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_rules [ 957.918862] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 957.918964] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f1230a-fcec-490a-98f5-6b0dfdbc0576 with Priority: HIGHEST for action port [ 957.919252] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.919410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.919410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.919667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.919749] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.921053] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.921053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.921053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.921053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.921204] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.922099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.922099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.922099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.922099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.922099] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.922597] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-48f1230a-fcec-490a-98f5-6b0dfdbc0576 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.923034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.923109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.923271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.923351] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f1230a-fcec-490a-98f5-6b0dfdbc0576',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.967270] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.968323] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.968398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.969041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.969041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.969179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.969246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.969282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.969532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.969810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.969933] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9937f05f-124d-494a-801f-dac861864434 is going to be updated. [ 957.999561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.999755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.999755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.000016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.000200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.012676] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9937f05f-124d-494a-801f-dac861864434 in Status: IN_PROGRESS for 2s [ 958.057444] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 958.057794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.058061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.058404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.058691] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.058883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.058993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.059297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.059368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.059465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.059612] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.425519] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.425762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.425988] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.427207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48f1230a-fcec-490a-98f5-6b0dfdbc0576 with status ACTIVE [ 958.427481] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.427652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.427753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.428086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.428212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.428475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.429123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.429123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.429123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.429284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.429620] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.429620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.429764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.429868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.430573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.430573] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48f1230a-fcec-490a-98f5-6b0dfdbc0576 is going to be updated. [ 958.457977] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.458165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.458218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.458434] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.458620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.458737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48f1230a-fcec-490a-98f5-6b0dfdbc0576" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.563053] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.563053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.563053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.563307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.563732] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.563732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.563732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.563980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.563980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.564067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.564189] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.564284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.564344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.564504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.564645] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.564736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.564818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.564967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.565196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.565196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.565284] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.676487] env[65107]: INFO networking_nsxv3.common.synchronization [req-a7af8dfd-42f3-4e13-b651-93e679d68acf req-abf7c8f4-4de8-4176-901e-b25a8bc888fe tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 958.677789] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 958.678163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.678622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.678696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.678957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.679135] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.679240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.679303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.679473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.679612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.679768] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.932594] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.067644] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2bd5d37-9901-465a-8751-6c1cb28889e3: rpc.has_security_group_logging(os_id): False [ 959.092021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.092021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.092021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.092021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.093017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.093017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.093017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.093017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.093017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.093017] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be updated. [ 959.111228] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.111732] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.112018] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.112426] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.112835] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.113204] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.113455] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.113935] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.114210] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.114547] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.114865] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.115120] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.117021] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.117021] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.117021] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.117021] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.148024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.148024] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.148024] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.148024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.148024] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.148024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.148024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.148024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.148024] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8b7198b-0836-4d69-b9a5-e193a83ddfb1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.185093] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.185093] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.185093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 already deleted. [ 959.185093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.186752] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.187031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.187330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.189171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.189171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.210347] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 959.436263] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.436491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.436491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.436743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.436839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.436937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be created. [ 959.463711] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.464016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.464119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.464387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.464681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.476162] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: UNINITIALIZED for 2s [ 959.650073] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.650509] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.650795] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.651266] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.651532] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.651851] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port e8b7198b-0836-4d69-b9a5-e193a83ddfb1 not found, creating... [ 959.652354] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.652654] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.652849] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.653232] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.653468] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.653981] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.654258] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.654480] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.654830] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.655101] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.655404] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: e8b7198b-0836-4d69-b9a5-e193a83ddfb1 is going to be created. [ 959.678411] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.678707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.678801] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.679131] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.679392] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.679661] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.025521] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9937f05f-124d-494a-801f-dac861864434 in Status: SUCCESS [ 960.025890] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9937f05f-124d-494a-801f-dac861864434 deletion is rescheduled due to dependency. [ 960.025890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.402278] env[65107]: INFO networking_nsxv3.common.synchronization [req-a7af8dfd-42f3-4e13-b651-93e679d68acf req-2cee7651-4a66-4acd-b2f1-747534d6f4e8 service nova] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_rules [ 960.402278] env[65107]: INFO networking_nsxv3.common.synchronization [req-a7af8dfd-42f3-4e13-b651-93e679d68acf req-2cee7651-4a66-4acd-b2f1-747534d6f4e8 service nova] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 960.402278] env[65107]: INFO networking_nsxv3.common.synchronization [req-a7af8dfd-42f3-4e13-b651-93e679d68acf req-2cee7651-4a66-4acd-b2f1-747534d6f4e8 service nova] Enqueued Resource ID: e8b7198b-0836-4d69-b9a5-e193a83ddfb1 with Priority: HIGHEST for action port [ 960.407932] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_rules [ 960.407932] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 960.407932] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8b7198b-0836-4d69-b9a5-e193a83ddfb1 with Priority: HIGHEST for action port [ 960.407932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.407932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.407932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.407932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.407932] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.408742] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.410686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.410686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.410686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.410686] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.410686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.410686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.410686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.410686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.410686] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.413082] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.413082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.413082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.413082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.413082] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8b7198b-0836-4d69-b9a5-e193a83ddfb1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.915711] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.916486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.916702] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.918599] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8b7198b-0836-4d69-b9a5-e193a83ddfb1 with status ACTIVE [ 960.918945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.919158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.919266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.919561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.919689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.919954] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.920123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.920225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.920477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.920611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.920912] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.921088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.921228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.921413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.921540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.921672] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8b7198b-0836-4d69-b9a5-e193a83ddfb1 is going to be updated. [ 960.962081] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.962277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.962547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.962547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.962694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.962914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8b7198b-0836-4d69-b9a5-e193a83ddfb1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.231754] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 961.232062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.320448] env[65107]: INFO networking_nsxv3.common.synchronization [req-e4d2ff17-92e8-47be-9751-602f13fd2f97 req-ea60b1f6-c273-4a46-9c32-cb8e5d9eeb4c tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 961.320807] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 961.321308] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.321444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.321510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.321874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.322117] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.322225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.322286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.322464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.322559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.322656] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.424574] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.488830] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 961.489086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.489268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.489506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.489715] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.489833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.489897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.490111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.490161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.490242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.490579] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.786943] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.786943] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.786943] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.786943] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.787268] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.787399] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.787523] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.787768] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.787909] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.788146] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.788248] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.788370] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.788471] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.788570] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.788689] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.788835] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.812478] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.812668] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.812921] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.813112] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.813467] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-919956ea-4c6e-4064-b420-68294a0f9d1b taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.813643] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.813831] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.814222] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.814384] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919956ea-4c6e-4064-b420-68294a0f9d1b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.825721] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.825966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.826318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.826318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.826412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.826876] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.826876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.826876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.827112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.827112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.827112] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e already deleted. [ 961.827213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.927750] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.928035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.928035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.928284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.928375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.928473] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 is going to be created. [ 961.954338] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.954591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.954591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.954814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.954999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.967258] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: UNINITIALIZED for 2s [ 961.993085] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.993358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.993461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.994195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.994195] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.994395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.994395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.994649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.994809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.994998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.995314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.995489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.995638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.995901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.996189] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.996351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.996462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.996696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.996865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.997041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.997228] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.318750] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.319156] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.319320] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.319745] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.319939] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.320268] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 919956ea-4c6e-4064-b420-68294a0f9d1b not found, creating... [ 962.320686] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.320985] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.321152] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.321534] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.321763] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.322173] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.322356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.322475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.322743] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.322953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.323163] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 919956ea-4c6e-4064-b420-68294a0f9d1b is going to be created. [ 962.350963] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.351216] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.351216] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.351463] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.351746] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.352023] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.500101] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1e2df-169e-4c48-af3a-0f40af269363: rpc.has_security_group_logging(os_id): False [ 962.521245] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.521429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.521481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.521695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.522113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.522453] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.522579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.522648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.522886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.522978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.523198] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.523297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.523359] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.523550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.523834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.524058] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.524158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.524222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.524366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.524444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.524530] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be created. [ 962.604266] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.604266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.604535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.604535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.604701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.620769] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 963.107780] env[65107]: INFO networking_nsxv3.common.synchronization [req-e4d2ff17-92e8-47be-9751-602f13fd2f97 req-6c1bf675-e9c0-40f1-ac30-2dbcb61472d4 service nova] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 963.107991] env[65107]: INFO networking_nsxv3.common.synchronization [req-e4d2ff17-92e8-47be-9751-602f13fd2f97 req-6c1bf675-e9c0-40f1-ac30-2dbcb61472d4 service nova] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 963.108148] env[65107]: INFO networking_nsxv3.common.synchronization [req-e4d2ff17-92e8-47be-9751-602f13fd2f97 req-6c1bf675-e9c0-40f1-ac30-2dbcb61472d4 service nova] Enqueued Resource ID: 919956ea-4c6e-4064-b420-68294a0f9d1b with Priority: HIGHEST for action port [ 963.108755] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 963.108897] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 963.108991] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 919956ea-4c6e-4064-b420-68294a0f9d1b with Priority: HIGHEST for action port [ 963.109309] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.109427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.109490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.109682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.109765] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.110651] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.110792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.110831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.110979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.111242] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.111242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.111369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.111406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.111473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.111564] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.112316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-919956ea-4c6e-4064-b420-68294a0f9d1b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.112409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.112484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.112614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.112687] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919956ea-4c6e-4064-b420-68294a0f9d1b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.614899] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.616123] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.616226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.616436] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 919956ea-4c6e-4064-b420-68294a0f9d1b with status ACTIVE [ 963.616569] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.616728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.616799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.616998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.617109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.617283] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.617379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.617431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.617593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.617671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.617865] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.617963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.618088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.618251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.618338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.618452] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 919956ea-4c6e-4064-b420-68294a0f9d1b is going to be updated. [ 963.644307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.644537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.644586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.644854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.644983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.645198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.824292] env[65107]: INFO networking_nsxv3.common.synchronization [req-928a45f4-6829-45fc-b96e-a1ef0debe119 req-fb27cf76-2168-4a9f-9fb5-f884a334dc3f tempest-ListServerFiltersTestJSON-2098391239 tempest-ListServerFiltersTestJSON-2098391239-project-member] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 963.825054] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 963.825460] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.825590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.825656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.825868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.827153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.827623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.827623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.827732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.827732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.827843] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.979898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: SUCCESS [ 963.980421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.980421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.980562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.980919] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.980919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.980919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.983222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.983222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.983222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.983222] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.120995] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.187052] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.187052] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.187052] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.187052] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.187618] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.187828] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.187961] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.188193] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.188383] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.188646] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.188759] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.188864] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.188971] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.189093] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.189196] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.189331] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.210948] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.211143] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.211281] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.211454] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.211764] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-e63bed1e-5a08-4459-9249-656c8bfff02c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.211933] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.212071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.212412] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.212547] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e63bed1e-5a08-4459-9249-656c8bfff02c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.330067] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.484395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.484395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.484395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.484699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.484808] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.484919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.484984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.485155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.485252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.485355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.485565] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.485666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.485726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.485884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.486029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.486029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.486029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.486029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.486530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.486530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.486607] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.623510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.623867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.623867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.623867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.624082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.624153] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e is going to be created. [ 964.637453] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 964.637733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.652844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.653034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.653034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.653243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.653396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.662222] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: UNINITIALIZED for 2s [ 964.717153] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.717382] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.717506] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.717775] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.717934] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.718108] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port e63bed1e-5a08-4459-9249-656c8bfff02c not found, creating... [ 964.718374] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.718531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.718645] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.718860] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.718996] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.719287] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.719438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.719552] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.719746] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.719876] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.720026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: e63bed1e-5a08-4459-9249-656c8bfff02c is going to be created. [ 964.746640] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.747084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.747341] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.747780] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.748189] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.748574] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.832605] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.989776] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5c10011-beb4-47e7-8405-2bfc31ee7de0: rpc.has_security_group_logging(os_id): False [ 965.011031] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.011208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.011208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.011804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.011942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.012158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.012385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.012457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.012628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.012705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.012915] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.013022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.013102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.013255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.013322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.013507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.013590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.013652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.013787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.013857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.013941] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 is going to be created. [ 965.080470] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.080623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.080691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.081051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.081180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.094967] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: IN_PROGRESS for 2s [ 965.335824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.335824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.336011] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.336293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.336293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.336397] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 965.381964] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.382228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.382228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.383854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.383854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.399051] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 965.513343] env[65107]: INFO networking_nsxv3.common.synchronization [req-928a45f4-6829-45fc-b96e-a1ef0debe119 req-2b9baf2e-f7bd-48c6-a60c-500bfd341ba1 service nova] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_rules [ 965.513497] env[65107]: INFO networking_nsxv3.common.synchronization [req-928a45f4-6829-45fc-b96e-a1ef0debe119 req-2b9baf2e-f7bd-48c6-a60c-500bfd341ba1 service nova] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 965.513634] env[65107]: INFO networking_nsxv3.common.synchronization [req-928a45f4-6829-45fc-b96e-a1ef0debe119 req-2b9baf2e-f7bd-48c6-a60c-500bfd341ba1 service nova] Enqueued Resource ID: e63bed1e-5a08-4459-9249-656c8bfff02c with Priority: HIGHEST for action port [ 965.514429] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_rules [ 965.514653] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 965.514878] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63bed1e-5a08-4459-9249-656c8bfff02c with Priority: HIGHEST for action port [ 965.515126] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.515298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.515367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.516030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.516134] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.517468] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.517565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.517866] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e63bed1e-5a08-4459-9249-656c8bfff02c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.518202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.518202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.518363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.518413] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e63bed1e-5a08-4459-9249-656c8bfff02c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.785379] env[65107]: INFO networking_nsxv3.common.synchronization [req-d1a18a4b-c0f8-4a7c-84ab-1e3b619c9244 req-87f67568-292f-41e6-a414-16f9a13c42a1 tempest-ServerActionsV293TestJSON-867971376 tempest-ServerActionsV293TestJSON-867971376-project-member] Enqueued Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_members [ 965.785379] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 with Priority: HIGHEST for action security_group_members [ 965.785379] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-9be39cfe-e706-4bf7-8816-70542b5cb472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.785379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.785379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.785765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.785765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.785843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.785843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.786506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.786506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.786506] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9be39cfe-e706-4bf7-8816-70542b5cb472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.020203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.020326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.020580] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e63bed1e-5a08-4459-9249-656c8bfff02c with status ACTIVE [ 966.020773] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.020911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.021016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.021257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.021346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.021531] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.021664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.021762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.021905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.022014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.022315] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.022385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.022758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.022758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.022758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.022758] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e63bed1e-5a08-4459-9249-656c8bfff02c is going to be updated. [ 966.052735] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.052735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.052735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.052735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.052735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.052735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e63bed1e-5a08-4459-9249-656c8bfff02c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.282332] env[65107]: INFO networking_nsxv3.common.synchronization [req-92374247-4038-4e68-936f-3b705dc9ea25 req-75b63682-5491-4279-9e2a-e37c0db9fbf6 tempest-ListServerFiltersTestJSON-2098391239 tempest-ListServerFiltersTestJSON-2098391239-project-member] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 966.283087] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 966.283431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.283557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.291475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.291698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.291816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.291984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.292102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.292310] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.292418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.296089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.296089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.296089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.296089] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 is going to be updated. [ 966.340475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.340475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.340475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.340475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.340475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.350293] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 in Status: IN_PROGRESS for 2s [ 966.678870] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: SUCCESS [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.678870] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.678870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.679538] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.692637] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.693124] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.693124] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.694799] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.695298] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.695589] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.695930] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.696327] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.696578] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.696896] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.697064] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.697236] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.697405] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.697599] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.697758] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.697929] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.724075] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.724075] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 966.724233] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.724338] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-385" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.724666] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-2031b7e3-8e45-49d1-833f-3c603346f1c2 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.724844] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.724964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.725334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.725597] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2031b7e3-8e45-49d1-833f-3c603346f1c2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.110679] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: SUCCESS [ 967.110679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.182405] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.228639] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.228883] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.228999] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.229350] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.229535] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.229649] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 2031b7e3-8e45-49d1-833f-3c603346f1c2 not found, creating... [ 967.229924] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.230156] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.230238] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.230525] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.230725] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.231066] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.231283] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.231420] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.231682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.231863] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.232045] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 2031b7e3-8e45-49d1-833f-3c603346f1c2 is going to be created. [ 967.254394] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.254605] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.254735] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.255015] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.255287] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.255532] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.415811] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 967.416145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.416350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.416590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.416817] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.416894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.417197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.417197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.417197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.417476] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.685701] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb36a1e8-ba8d-491f-8291-18b58f2dfd6e: rpc.has_security_group_logging(os_id): False [ 967.705997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.706198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.706239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.706467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.706577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.706812] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.706913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.706971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.707379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.707379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.707379] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e is going to be created. [ 967.778988] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.779244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.779378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.779691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.780016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.792320] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: IN_PROGRESS for 2s [ 967.920997] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.029445] env[65107]: INFO networking_nsxv3.common.synchronization [req-92374247-4038-4e68-936f-3b705dc9ea25 req-b53d02f2-30be-47ba-8096-f901d27d0b92 service nova] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_rules [ 968.029765] env[65107]: INFO networking_nsxv3.common.synchronization [req-92374247-4038-4e68-936f-3b705dc9ea25 req-b53d02f2-30be-47ba-8096-f901d27d0b92 service nova] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 968.029976] env[65107]: INFO networking_nsxv3.common.synchronization [req-92374247-4038-4e68-936f-3b705dc9ea25 req-b53d02f2-30be-47ba-8096-f901d27d0b92 service nova] Enqueued Resource ID: 2031b7e3-8e45-49d1-833f-3c603346f1c2 with Priority: HIGHEST for action port [ 968.030824] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_rules [ 968.030824] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 968.031151] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2031b7e3-8e45-49d1-833f-3c603346f1c2 with Priority: HIGHEST for action port [ 968.031952] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.032132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.033154] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.033154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.033154] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-2031b7e3-8e45-49d1-833f-3c603346f1c2 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.033154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.033154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.033752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.033752] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2031b7e3-8e45-49d1-833f-3c603346f1c2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.362551] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 in Status: SUCCESS [ 968.362551] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9be39cfe-e706-4bf7-8816-70542b5cb472 deletion is rescheduled due to dependency. [ 968.362551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9be39cfe-e706-4bf7-8816-70542b5cb472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.423559] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.537065] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2031b7e3-8e45-49d1-833f-3c603346f1c2 with status ACTIVE [ 968.537369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.540093] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.540093] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.540093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.540093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2031b7e3-8e45-49d1-833f-3c603346f1c2 is going to be updated. [ 968.566214] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.566374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.566442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.566873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.566873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.566989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2031b7e3-8e45-49d1-833f-3c603346f1c2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.868814] env[65107]: INFO networking_nsxv3.common.synchronization [req-8242f3b7-8d2b-47a0-ab68-216faa3b23e4 req-fdb46c77-12ac-481e-bd77-2b6a9c000166 tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 968.869396] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 968.869816] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.870126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.870126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.870274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.870432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.870531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.870590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.870747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.870931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.871052] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.926613] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.926921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.926921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.927197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.927301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.927429] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 968.962086] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.962233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.962311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.962521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.962656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.973036] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 969.330248] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.330471] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.330619] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.330957] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.331253] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.331451] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.331548] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.333054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.333054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.333054] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.333054] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.333054] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.333054] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.333054] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.334568] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.334762] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.357543] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.357818] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.357950] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.358155] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.358804] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-c783d9ec-1cac-468b-a1e8-8e837090f49b taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.358921] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.358963] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.359379] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.359534] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c783d9ec-1cac-468b-a1e8-8e837090f49b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.373839] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.374265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.374265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.374415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.374508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.374708] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.374878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.374878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.375021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.375093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.375178] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 already deleted. [ 969.375279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.803591] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: SUCCESS [ 969.803591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.862890] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.863218] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.863376] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.863682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.863828] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.864017] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port c783d9ec-1cac-468b-a1e8-8e837090f49b not found, creating... [ 969.864312] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.864560] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.864635] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.864851] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.864988] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.865283] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.865435] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.865549] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.865745] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.865875] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.866017] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: c783d9ec-1cac-468b-a1e8-8e837090f49b is going to be created. [ 969.889142] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.889368] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.889489] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.889764] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.889997] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.890238] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.716777] env[65107]: INFO networking_nsxv3.common.synchronization [req-8242f3b7-8d2b-47a0-ab68-216faa3b23e4 req-ce39eab6-d510-49bd-93c5-1243ba5afe58 service nova] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_rules [ 970.716777] env[65107]: INFO networking_nsxv3.common.synchronization [req-8242f3b7-8d2b-47a0-ab68-216faa3b23e4 req-ce39eab6-d510-49bd-93c5-1243ba5afe58 service nova] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 970.716777] env[65107]: INFO networking_nsxv3.common.synchronization [req-8242f3b7-8d2b-47a0-ab68-216faa3b23e4 req-ce39eab6-d510-49bd-93c5-1243ba5afe58 service nova] Enqueued Resource ID: c783d9ec-1cac-468b-a1e8-8e837090f49b with Priority: HIGHEST for action port [ 970.719384] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_rules [ 970.719384] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 970.719505] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c783d9ec-1cac-468b-a1e8-8e837090f49b with Priority: HIGHEST for action port [ 970.720027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.721123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.721226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.721489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.721576] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.722490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.722610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.722678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.722862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.723059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.723160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.723227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.723397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.723499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.723600] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.724591] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c783d9ec-1cac-468b-a1e8-8e837090f49b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.724591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.724710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.724748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.724838] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c783d9ec-1cac-468b-a1e8-8e837090f49b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.987667] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 970.987967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.988206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.988499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.988766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.989289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.989787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.990550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.990602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.990710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.990871] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.992773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.993168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.993563] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.993705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.993737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.993991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.994579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.994579] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.227551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.227804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.228084] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.228832] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c783d9ec-1cac-468b-a1e8-8e837090f49b with status ACTIVE [ 971.229047] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.229162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.229228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.229467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.229556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.229737] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.229833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.229918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.230052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.230131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.230313] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.230407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.230457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.230590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.230664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.230751] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c783d9ec-1cac-468b-a1e8-8e837090f49b is going to be updated. [ 971.254733] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.255194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.255328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.255712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.255712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.256157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c783d9ec-1cac-468b-a1e8-8e837090f49b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.497357] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.497611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.500097] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.733493] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.004300] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.238258] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.238501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.238501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.238808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.238874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.239016] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be created. [ 972.274019] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.274019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.274019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.274019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.274340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.290556] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: UNINITIALIZED for 2s [ 972.506777] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.507029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.507160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.507393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.507523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.507632] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 972.568786] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.569070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.569123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.569722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.569722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.583897] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 974.307215] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 974.307613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.307613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.308169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.308655] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.308731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.308792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.308955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.309076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.309131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.309227] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.596557] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 974.596802] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.596959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.597203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.597403] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.597741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.597837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.598020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.598119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.598214] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.813222] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.813408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.813472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.813751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.813927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.814088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.814175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.814343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.814431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.814530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.814705] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.814855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.814905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.815052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.815292] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.815292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.815383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.815450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.815523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.815602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.815740] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.100747] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.317958] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24eb74d4-e639-4e5a-b7df-49fe504362b3: rpc.has_security_group_logging(os_id): False [ 975.337931] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.338083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.338168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.338445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.338573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.338872] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.338947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.339013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.339244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.339347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.339544] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.339666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.339767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.339935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.340242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.340448] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.340593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.340677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.340843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.340940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.341048] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be created. [ 975.405658] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.405871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.405980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.406226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.406408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.418345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 975.604296] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.720739] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 975.720883] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 976.110784] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.110968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.111021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.111271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.111400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.111557] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 976.154925] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.155104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.155161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.155393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.155549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.169618] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 976.695028] env[65107]: INFO networking_nsxv3.common.synchronization [req-43e76ba7-bbb7-41a4-a16a-d10c68e2b661 req-9ed83bb6-a599-4d28-aec4-6aa687c54557 tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 976.695424] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 976.696035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.696035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.696035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.696246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.696381] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.696484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.696547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.696705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.696795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.696888] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.943224] env[65107]: INFO networking_nsxv3.common.synchronization [None req-6a8f99b2-49e3-4d1a-85c6-cf895dfa0f15 None None] Enqueued Resource ID: 66ca73c2-2acd-4762-87bf-9ac0f642b061 with Priority: HIGHEST for action port [ 976.944273] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ca73c2-2acd-4762-87bf-9ac0f642b061 with Priority: HIGHEST for action port [ 976.944273] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-66ca73c2-2acd-4762-87bf-9ac0f642b061 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.944273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66ca73c2-2acd-4762-87bf-9ac0f642b061" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.944477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66ca73c2-2acd-4762-87bf-9ac0f642b061" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.945222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66ca73c2-2acd-4762-87bf-9ac0f642b061" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.945308] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66ca73c2-2acd-4762-87bf-9ac0f642b061',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.199498] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.199901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.199994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.200337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.200492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.200728] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.200877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.200999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.201218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.201304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.201395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 977.236401] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.236401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.236401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.236401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.236401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.249615] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 977.430439] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.430676] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.430828] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.431642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.432017] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.432218] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.432335] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.432575] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.432717] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.432926] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.433103] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.433228] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.433335] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.433462] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.433570] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.433785] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.435649] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 977.435863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.448044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66ca73c2-2acd-4762-87bf-9ac0f642b061 [ 977.448323] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.448503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.448610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.448788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.448911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.449042] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66ca73c2-2acd-4762-87bf-9ac0f642b061 already deleted. [ 977.449165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66ca73c2-2acd-4762-87bf-9ac0f642b061" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.454567] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.454777] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.455053] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.455297] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.456301] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-801e46c9-f425-477c-8fe6-d94624ced873 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.456581] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.456792] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.457294] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.457536] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('801e46c9-f425-477c-8fe6-d94624ced873',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.961132] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.961564] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.961682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.961997] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.962297] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.962419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 801e46c9-f425-477c-8fe6-d94624ced873 not found, creating... [ 977.962751] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.963393] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.963393] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.963393] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.963531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.963799] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.963954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.964757] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.965050] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.965201] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.965384] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 801e46c9-f425-477c-8fe6-d94624ced873 is going to be created. [ 977.988445] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.988445] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.988445] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.988445] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.988641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.988881] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.185594] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 978.185880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.186160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.186506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.186783] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.186958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.187099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.187340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.187465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.187602] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.187902] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.188077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.188182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.188417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.188676] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.188829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.188927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.189165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.189320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.189463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.189610] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.692239] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1e2df-169e-4c48-af3a-0f40af269363: rpc.has_security_group_logging(os_id): False [ 978.714628] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.714885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.714885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.715169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.715309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.715627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.715810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.715915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.716046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.716157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.716359] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.716469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.716534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.716714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.716986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.717057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.717144] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.717214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.717527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.717641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.717739] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 978.795864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.796646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.796646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.796646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.796646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.819162] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 978.835084] env[65107]: INFO networking_nsxv3.common.synchronization [req-43e76ba7-bbb7-41a4-a16a-d10c68e2b661 req-bf057d38-0fb3-49e2-93f6-172aebb217fc service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 978.835084] env[65107]: INFO networking_nsxv3.common.synchronization [req-43e76ba7-bbb7-41a4-a16a-d10c68e2b661 req-bf057d38-0fb3-49e2-93f6-172aebb217fc service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 978.835084] env[65107]: INFO networking_nsxv3.common.synchronization [req-43e76ba7-bbb7-41a4-a16a-d10c68e2b661 req-bf057d38-0fb3-49e2-93f6-172aebb217fc service nova] Enqueued Resource ID: 801e46c9-f425-477c-8fe6-d94624ced873 with Priority: HIGHEST for action port [ 978.836144] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 978.836144] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 978.836144] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 801e46c9-f425-477c-8fe6-d94624ced873 with Priority: HIGHEST for action port [ 978.836665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.836665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.836665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.837018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.837018] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.838241] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.838421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.838658] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-801e46c9-f425-477c-8fe6-d94624ced873 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.838804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.838886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.839139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.839238] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('801e46c9-f425-477c-8fe6-d94624ced873',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.261407] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 979.261796] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 979.261796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.261916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.262141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.262352] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.262499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.262565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.264260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.264260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.264260] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.334148] env[65107]: INFO networking_nsxv3.common.synchronization [None req-f156a470-6e9b-45b9-ba31-b42cdbf18d02 None None] Enqueued Resource ID: 26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0 with Priority: HIGHEST for action port [ 979.334148] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0 with Priority: HIGHEST for action port [ 979.334872] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.335259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.335259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.335531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.335653] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.341844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.341844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.344763] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 801e46c9-f425-477c-8fe6-d94624ced873 with status ACTIVE [ 979.345088] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.345519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.345519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.345885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.345885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.346055] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.346564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.346564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.346564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.346681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.346934] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.349151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.349310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.349592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.349719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.349853] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 801e46c9-f425-477c-8fe6-d94624ced873 is going to be updated. [ 979.377611] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.377738] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.378486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.378486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.378486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.379433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-801e46c9-f425-477c-8fe6-d94624ced873" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.769272] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.838560] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0 [ 979.838700] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.838777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.839142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.839142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.839231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.839733] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0 already deleted. [ 979.839733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26c6851e-cfdf-4d61-9283-3a4c2ed4f0d0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.272526] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.775826] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.776041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.776125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.776393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.776541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.776883] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 980.809863] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.810032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.810110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.810349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.810523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.823757] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 980.839626] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 980.839804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.840465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.840686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.840777] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.345308] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.345308] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.345308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.345308] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.850437] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.850437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.850437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.850637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.850745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.850855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.850919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.851129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.851194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.851344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.851404] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.851522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.851558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.851698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.851834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.851977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.851977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.852122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.852221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.852294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.852378] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.356257] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1e2df-169e-4c48-af3a-0f40af269363: rpc.has_security_group_logging(os_id): False [ 982.376420] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.376574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.376647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.376861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.376963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.377210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.377309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.377373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.377519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.377606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.377772] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.377862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.377922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.378112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.378193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.378372] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.378463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.378520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.378655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.378727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.378815] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 982.456900] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.456900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.456900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.456900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.456900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.473552] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 982.836035] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 982.836035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.836260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.836395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.836592] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.836709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.836774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.836925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.837014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.837105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.837196] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.340132] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.340383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.340487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.340873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.341171] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.341305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.341379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.341571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.341665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.341759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.341927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.342034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.342096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.342273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.342487] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.342625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.342697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.342961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.342961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.343058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.343161] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.846942] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6970c294-30ba-4814-9be8-ff7a47ecd5e8: rpc.has_security_group_logging(os_id): False [ 983.868012] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.868229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.868229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.868585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.868743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.869057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.869241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.869307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.869546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.869649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.869976] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.870155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.870329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.870472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.870597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.870803] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.870944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.871095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.871320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.871422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.871535] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 983.950891] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.951131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.951262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.951740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.952026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.974190] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 984.335685] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 984.335748] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 984.495850] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 984.496361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.562496] env[65107]: INFO networking_nsxv3.common.synchronization [req-2cc64f6c-4455-4ab6-911c-f7c13a1c1761 req-70997353-ae10-4e7b-917c-c7ce7c4fc3e7 tempest-AttachInterfacesV270Test-1786016021 tempest-AttachInterfacesV270Test-1786016021-project-member] Enqueued Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_members [ 985.563097] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_members [ 985.563522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff45994-1b33-49a8-9e8d-d4e639f2b297 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.563624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.563624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.563882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.564058] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.564293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.564293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.564387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.564471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.564535] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.952298] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.952553] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-374" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.952645] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-374" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.953050] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-374" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.953461] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.953675] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.953839] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.954138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.954388] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.954663] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.954850] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.954977] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.955164] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.955323] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.955459] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.955610] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.990968] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.991175] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.991367] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.991640] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-374" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.992259] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-0f7c1812-17a3-418b-90ff-3427a3c54b5a taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.992495] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.992641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.993070] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.993292] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f7c1812-17a3-418b-90ff-3427a3c54b5a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.995775] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 985.996036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.066782] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.067330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.067330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.067330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.067489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.067723] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.067890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.067960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.068234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.068369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.068508] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 already deleted. [ 986.068646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.496554] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.496827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.496994] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.497475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.499037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.499037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 0f7c1812-17a3-418b-90ff-3427a3c54b5a not found, creating... [ 986.499037] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.499037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.499037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.499037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.499037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.499037] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.499419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.499419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.499419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.499524] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.499653] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 0f7c1812-17a3-418b-90ff-3427a3c54b5a is going to be created. [ 986.521986] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.522216] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.522310] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.522613] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.522890] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.523165] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.001415] env[65107]: INFO networking_nsxv3.common.synchronization [req-b7a87d1f-3f5d-4388-ae8e-9baf4194a0cd req-7b58bf22-9138-403f-b3fa-0e9835902054 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 987.001986] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 987.002351] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.002472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.003124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.003124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.003124] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.003124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.003124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.003386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.003386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.003386] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.206036] env[65107]: INFO networking_nsxv3.common.synchronization [req-2cc64f6c-4455-4ab6-911c-f7c13a1c1761 req-d688de7c-b548-4f1f-8463-461c8245c130 service nova] Enqueued Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_rules [ 987.206236] env[65107]: INFO networking_nsxv3.common.synchronization [req-2cc64f6c-4455-4ab6-911c-f7c13a1c1761 req-d688de7c-b548-4f1f-8463-461c8245c130 service nova] Enqueued Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_members [ 987.206374] env[65107]: INFO networking_nsxv3.common.synchronization [req-2cc64f6c-4455-4ab6-911c-f7c13a1c1761 req-d688de7c-b548-4f1f-8463-461c8245c130 service nova] Enqueued Resource ID: 0f7c1812-17a3-418b-90ff-3427a3c54b5a with Priority: HIGHEST for action port [ 987.207111] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_rules [ 987.207111] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_members [ 987.207111] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f7c1812-17a3-418b-90ff-3427a3c54b5a with Priority: HIGHEST for action port [ 987.207396] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ff45994-1b33-49a8-9e8d-d4e639f2b297 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.207577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.207577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.207838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.207914] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.208767] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff45994-1b33-49a8-9e8d-d4e639f2b297 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.208905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.208973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.209157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.209301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.209396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.209456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.209623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.209707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.209796] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.213015] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f7c1812-17a3-418b-90ff-3427a3c54b5a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.213136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.213295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.213376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.213429] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f7c1812-17a3-418b-90ff-3427a3c54b5a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.359834] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.360073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.360162] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.360421] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.360667] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.360830] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.360923] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.361138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.361383] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.361635] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.361790] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.361895] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.361990] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.362111] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.362218] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.362348] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.385245] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.385601] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 987.385831] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.386058] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.386426] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-81563a00-b42b-4912-8382-ee2591750a72 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.386607] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.386727] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.387049] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.387206] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81563a00-b42b-4912-8382-ee2591750a72',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.506532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.506962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.506962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.507043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.507155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.507337] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.507445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.507510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.507668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.507774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.507866] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 987.539705] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.539971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.540085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.540367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.540555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.550816] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 987.715188] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.716751] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff45994-1b33-49a8-9e8d-d4e639f2b297 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.717672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.717672] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f7c1812-17a3-418b-90ff-3427a3c54b5a with status ACTIVE [ 987.717672] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.717672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.717672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.717672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.717672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.718041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.718041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.718041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.719189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.719365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.719627] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.719730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.719795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.719948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.720055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.720131] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f7c1812-17a3-418b-90ff-3427a3c54b5a is going to be updated. [ 987.756557] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.756760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.756831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.757158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.757319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.757535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f7c1812-17a3-418b-90ff-3427a3c54b5a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.889973] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.890380] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.890626] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.890956] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.891172] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.891425] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 81563a00-b42b-4912-8382-ee2591750a72 not found, creating... [ 987.892138] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.892460] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.892711] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.893350] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.893657] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.894210] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.894481] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.894699] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.895097] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.895426] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.895607] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 81563a00-b42b-4912-8382-ee2591750a72 is going to be created. [ 987.916846] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.917098] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.917243] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.917609] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.917921] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.918217] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.222184] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.660471] env[65107]: INFO networking_nsxv3.common.synchronization [req-b7a87d1f-3f5d-4388-ae8e-9baf4194a0cd req-3ab608b6-86fb-4702-831c-1ae622925810 service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 988.660649] env[65107]: INFO networking_nsxv3.common.synchronization [req-b7a87d1f-3f5d-4388-ae8e-9baf4194a0cd req-3ab608b6-86fb-4702-831c-1ae622925810 service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 988.661435] env[65107]: INFO networking_nsxv3.common.synchronization [req-b7a87d1f-3f5d-4388-ae8e-9baf4194a0cd req-3ab608b6-86fb-4702-831c-1ae622925810 service nova] Enqueued Resource ID: 81563a00-b42b-4912-8382-ee2591750a72 with Priority: HIGHEST for action port [ 988.663030] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 988.663250] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 988.663391] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81563a00-b42b-4912-8382-ee2591750a72 with Priority: HIGHEST for action port [ 988.663747] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.663900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.663990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.664232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.664364] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.666881] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.666881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.666881] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-81563a00-b42b-4912-8382-ee2591750a72 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.666881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.666881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.666881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.666881] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81563a00-b42b-4912-8382-ee2591750a72',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.725936] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.726181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.726181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.726382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.726475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.726572] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 is going to be created. [ 988.751461] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.751723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.751820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.752054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.752303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.765325] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 in Status: UNINITIALIZED for 2s [ 989.168478] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.168686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.168856] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81563a00-b42b-4912-8382-ee2591750a72 with status ACTIVE [ 989.169067] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.169186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.169249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.169485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.169590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.169855] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.169971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.170033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.170210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.170296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.170489] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.170579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.170636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.170807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.170910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.170991] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81563a00-b42b-4912-8382-ee2591750a72 is going to be updated. [ 989.196784] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.197058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.197136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.197484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.197668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.197833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81563a00-b42b-4912-8382-ee2591750a72" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.563189] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 989.563655] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed deletion is rescheduled due to dependency. [ 989.563655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.563744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.563928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.564135] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.564273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.564344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.564498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.564599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.564698] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.067472] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.570061] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.778027] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 in Status: SUCCESS [ 990.778027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.778027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.778027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.778027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.778428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.778428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.778428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.778553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.778608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.778710] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.072892] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.073177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.073177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.073417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.073574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.073696] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 991.102552] env[65107]: INFO networking_nsxv3.common.synchronization [req-3d84530c-4743-423a-95a8-d9be10048943 req-c47fb882-b2db-4178-98c5-3b095d391fbb tempest-ServersTestManualDisk-1947433380 tempest-ServersTestManualDisk-1947433380-project-member] Enqueued Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_members [ 991.103346] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGHEST for action security_group_members [ 991.103620] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.103756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.103756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.103989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.104141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.104244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.104305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.104485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.104574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.104672] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.115260] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.115489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.115576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.115767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.116332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.129216] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 991.281378] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff45994-1b33-49a8-9e8d-d4e639f2b297 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.281701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.281701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.282066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.282349] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.282517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.282632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.282862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.283103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.283173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.283465] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff45994-1b33-49a8-9e8d-d4e639f2b297 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.283614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.283709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.283944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.284179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.284336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.284408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.284642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.284769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.284901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.285086] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.607017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.607425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.607473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.607994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.607994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.608166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.608166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.608261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.608399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.608479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.608578] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de is going to be updated. [ 991.650650] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.650861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.650912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.651261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.651685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.674282] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de in Status: IN_PROGRESS for 2s [ 991.790025] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ff45994-1b33-49a8-9e8d-d4e639f2b297: rpc.has_security_group_logging(os_id): False [ 991.826253] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.826253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.826253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.826253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.826807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.826807] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.826961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.827121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.827437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.827613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.827993] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.828200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.828328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.828583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.828749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.829049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.829225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.829327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.829585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.829739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.829908] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 is going to be created. [ 991.928381] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.928595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.928816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.929238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.929547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.946665] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 in Status: IN_PROGRESS for 2s [ 993.140343] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 993.140699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.140803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.141027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.141220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.141328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.141397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.141564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.141648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.141739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.141813] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.644375] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.645024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.645024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.645024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.645167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.645345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.645437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.645641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.645920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.646066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.646246] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.646445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.646518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.646679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.646826] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.646918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.646979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.647820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.647820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.647820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.647820] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.685419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de in Status: SUCCESS [ 993.685782] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de deletion is rescheduled due to dependency. [ 993.685915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.959416] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 in Status: SUCCESS [ 993.960017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.153275] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 814a62b8-5b9a-4a8b-96c6-18956744a0ed: rpc.has_security_group_logging(os_id): False [ 994.172180] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.172337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.172404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.172616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.172711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.173212] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.173212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.173212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.173212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.173455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.173901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.173901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.173901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.173901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.174067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.174414] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.174414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.174414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.174589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.174620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.174819] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 994.242265] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4964941e-88e6-4f26-8ef6-7d4e337440d5 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 994.246236] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.246236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.246236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.246236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.246236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.246587] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 994.247283] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.247283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.247283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.247283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.247553] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.247553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.247626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.247837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.247921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.248312] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.263888] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 994.751051] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.254322] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.757895] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.758121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.758172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.758371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.758691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.758902] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 995.794959] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.795141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.795208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.795424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.795569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.807222] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 996.274272] env[65107]: INFO networking_nsxv3.common.synchronization [req-6edbaa89-0a5a-44b2-9d41-33bafe6db9d7 req-3556e3c2-307c-4ca9-b4a9-f3125aec0901 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 996.274869] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 996.275211] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.275403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.275477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.275788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.276108] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.276223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.276288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.276454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.276581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.276728] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.278833] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 996.279169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.559555] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.559798] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.559923] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.560285] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.560556] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.560715] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.560829] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.561080] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.561276] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.561501] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.561615] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.561721] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.561827] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.561934] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.562049] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.562183] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.579937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.580123] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.580287] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.580465] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.580766] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.580932] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.581076] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.581466] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.581653] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae18ae3-c2d8-4737-96a1-6a72757bcbaf',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.779682] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.779920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.780079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.780346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.780509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.780784] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.780910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.781016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.781276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.781495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.781646] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 is going to be updated. [ 996.813665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.813951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.813951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.814097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.814237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.824169] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: IN_PROGRESS for 2s [ 997.083932] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.084231] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.084365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.084679] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.084873] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.085206] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 9ae18ae3-c2d8-4737-96a1-6a72757bcbaf not found, creating... [ 997.085609] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.085849] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.086057] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.086382] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.086565] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.086940] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.087210] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.087291] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.087588] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.087809] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.087971] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 9ae18ae3-c2d8-4737-96a1-6a72757bcbaf is going to be created. [ 997.108613] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.108841] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.108972] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.109303] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.109782] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.110051] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.819195] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 997.819740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.860241] env[65107]: INFO networking_nsxv3.common.synchronization [req-456b9850-26df-4c4d-bcc0-19613d511a98 req-418335fe-e6df-4406-89ba-7e8acc940d53 service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 997.860431] env[65107]: INFO networking_nsxv3.common.synchronization [req-456b9850-26df-4c4d-bcc0-19613d511a98 req-418335fe-e6df-4406-89ba-7e8acc940d53 service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 997.860572] env[65107]: INFO networking_nsxv3.common.synchronization [req-456b9850-26df-4c4d-bcc0-19613d511a98 req-418335fe-e6df-4406-89ba-7e8acc940d53 service nova] Enqueued Resource ID: 9ae18ae3-c2d8-4737-96a1-6a72757bcbaf with Priority: HIGHEST for action port [ 997.861114] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 997.861256] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 997.861353] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae18ae3-c2d8-4737-96a1-6a72757bcbaf with Priority: HIGHEST for action port [ 997.861635] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.861758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.861823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.862223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.862339] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.863696] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.863987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.864082] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.864264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.864510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.864610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.864677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.864826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.864916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.865059] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.866745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.866866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.866906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.867196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.867303] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae18ae3-c2d8-4737-96a1-6a72757bcbaf',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.364429] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.364799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.369182] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.370450] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ae18ae3-c2d8-4737-96a1-6a72757bcbaf with status ACTIVE [ 998.370765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.371043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.371951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.371951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.371951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.371951] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.372139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.372139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.372388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.372508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.372820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.372978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.373116] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.373350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.373557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.373737] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ae18ae3-c2d8-4737-96a1-6a72757bcbaf is going to be updated. [ 998.400583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.400865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.400865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.401033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.401177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.401337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ae18ae3-c2d8-4737-96a1-6a72757bcbaf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.835170] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: SUCCESS [ 998.835560] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 deletion is rescheduled due to dependency. [ 998.835560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.875945] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.379078] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.379250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.379440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.379833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.380191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.380819] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 999.414116] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.414310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.414432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.414721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.414874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.426132] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1001.445829] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1001.447136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.447136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.447136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.447136] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.447136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.447136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.447529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.447529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.448699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.448699] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.940435] env[65107]: INFO networking_nsxv3.common.synchronization [None req-5c5b2338-5fac-4900-90a6-c136e56aee07 None None] Enqueued Resource ID: 33c701fc-41bd-4ad6-bd3d-4a4757909cbf with Priority: HIGHEST for action port [ 1001.941025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c701fc-41bd-4ad6-bd3d-4a4757909cbf with Priority: HIGHEST for action port [ 1001.941884] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c701fc-41bd-4ad6-bd3d-4a4757909cbf taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.941884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c701fc-41bd-4ad6-bd3d-4a4757909cbf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.941884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c701fc-41bd-4ad6-bd3d-4a4757909cbf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.942257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c701fc-41bd-4ad6-bd3d-4a4757909cbf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.942439] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c701fc-41bd-4ad6-bd3d-4a4757909cbf',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.955187] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.955410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.955463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.955788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.956092] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.956092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.956220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.956382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.956507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.956613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.956824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.956945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.957053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.957268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.957443] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.957573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.957638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.957987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.958089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.958180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.958301] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.446750] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33c701fc-41bd-4ad6-bd3d-4a4757909cbf [ 1002.447168] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.447168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.447325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.447440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.447536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.447632] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33c701fc-41bd-4ad6-bd3d-4a4757909cbf already deleted. [ 1002.447711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c701fc-41bd-4ad6-bd3d-4a4757909cbf" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.465031] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 814a62b8-5b9a-4a8b-96c6-18956744a0ed: rpc.has_security_group_logging(os_id): False [ 1002.484185] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.484367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.484449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.484627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.484751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.485017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.485474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.485474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.485474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.485474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.485595] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.485653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.485774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.485856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.486028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.486110] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.486205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.486265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.486451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.486570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.486665] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1002.551468] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.551669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.551669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.551884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.552083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.570069] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1003.108867] env[65107]: INFO networking_nsxv3.common.synchronization [req-902d56a8-900c-4957-9118-475f104b86ce req-86e3e776-6fd1-4e0c-9df3-0df2339a7320 tempest-AttachInterfacesV270Test-1786016021 tempest-AttachInterfacesV270Test-1786016021-project-member] Enqueued Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_members [ 1003.109718] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 with Priority: HIGHEST for action security_group_members [ 1003.109945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff45994-1b33-49a8-9e8d-d4e639f2b297 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.111636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.111636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.111636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.111636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.111636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.111636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.112280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.112798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.112798] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff45994-1b33-49a8-9e8d-d4e639f2b297',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.532229] env[65107]: INFO networking_nsxv3.common.synchronization [req-b49529dd-654d-45e0-ac8c-797bf122091f req-ba50d18d-f159-4f9a-85ca-85064b768bbe tempest-SecurityGroupRulesTestJSON-1776800561 tempest-SecurityGroupRulesTestJSON-1776800561-project-member] Enqueued Resource ID: 1952525b-2c54-4de8-a112-96a73ca3268a with Priority: HIGHEST for action security_group_rules [ 1003.537089] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1952525b-2c54-4de8-a112-96a73ca3268a with Priority: HIGHEST for action security_group_rules [ 1003.537704] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1952525b-2c54-4de8-a112-96a73ca3268a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.537704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1952525b-2c54-4de8-a112-96a73ca3268a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.537917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1952525b-2c54-4de8-a112-96a73ca3268a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.538095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1952525b-2c54-4de8-a112-96a73ca3268a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.538095] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1952525b-2c54-4de8-a112-96a73ca3268a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.615981] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.616160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.616223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.616442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.616535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.619205] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.619205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.619205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.619205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.619205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.619205] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 is going to be updated. [ 1003.647100] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.647100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.647100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.647100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.647100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.656591] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 in Status: IN_PROGRESS for 2s [ 1004.062908] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.063113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.063113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.063294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.063372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.063444] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1952525b-2c54-4de8-a112-96a73ca3268a already deleted. [ 1004.063578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1952525b-2c54-4de8-a112-96a73ca3268a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.219504] env[65107]: INFO networking_nsxv3.common.synchronization [req-6e8d0597-e02c-4bc9-9ae9-84a7f1d5bc5b req-41171d2a-578d-40be-b068-28678843d57f tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1004.219907] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1004.220227] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.220567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.220567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.220778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.220778] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.221123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.221123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.222834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.222834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.222834] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.304501] env[65107]: INFO networking_nsxv3.common.synchronization [req-90293c6c-75a1-4314-866b-e4878ee247c1 req-d1554e97-78cd-4b95-aad7-bbd183afcfa0 tempest-SecurityGroupRulesTestJSON-1776800561 tempest-SecurityGroupRulesTestJSON-1776800561-project-member] Enqueued Resource ID: 9e99fce3-6743-4d5f-9a6a-650cfc7fdd83 with Priority: HIGHEST for action security_group_rules [ 1004.305040] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e99fce3-6743-4d5f-9a6a-650cfc7fdd83 with Priority: HIGHEST for action security_group_rules [ 1004.305357] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e99fce3-6743-4d5f-9a6a-650cfc7fdd83 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.305465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e99fce3-6743-4d5f-9a6a-650cfc7fdd83" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.306580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e99fce3-6743-4d5f-9a6a-650cfc7fdd83" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.306580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e99fce3-6743-4d5f-9a6a-650cfc7fdd83" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.306580] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e99fce3-6743-4d5f-9a6a-650cfc7fdd83',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.425583] env[65107]: INFO networking_nsxv3.common.synchronization [None req-2cca70e5-c5e0-44a3-8c9d-f93365634f6e None None] Enqueued Resource ID: a0bbae6d-2f6a-4e04-96e8-94a19fd958d2 with Priority: HIGHEST for action port [ 1004.425583] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bbae6d-2f6a-4e04-96e8-94a19fd958d2 with Priority: HIGHEST for action port [ 1004.425583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0bbae6d-2f6a-4e04-96e8-94a19fd958d2 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.425583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0bbae6d-2f6a-4e04-96e8-94a19fd958d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.425583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0bbae6d-2f6a-4e04-96e8-94a19fd958d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.425583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0bbae6d-2f6a-4e04-96e8-94a19fd958d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.425583] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0bbae6d-2f6a-4e04-96e8-94a19fd958d2',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.575711] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e5cfd3ba-7f93-49fb-b159-203350d225ca tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_rules [ 1004.576900] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_rules [ 1004.576953] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.577307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.577307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.577429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.577492] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.592529] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1004.592529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.677022] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e76ea31b-a9aa-4aa2-b43c-8aa9eb69db17 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_rules [ 1004.677871] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_rules [ 1004.678310] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.678441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.724900] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.725227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.725227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.725340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.725604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.725604] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.725731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.725853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.725905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.725957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.726058] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1004.756059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.756240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.756310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.756543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.756716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.767090] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1004.829139] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.829139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.829139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.829139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.829139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.829139] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e99fce3-6743-4d5f-9a6a-650cfc7fdd83 already deleted. [ 1004.829139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e99fce3-6743-4d5f-9a6a-650cfc7fdd83" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.928211] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0bbae6d-2f6a-4e04-96e8-94a19fd958d2 [ 1004.928451] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.928585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.928775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.928876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.928969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.929076] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0bbae6d-2f6a-4e04-96e8-94a19fd958d2 already deleted. [ 1004.929160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0bbae6d-2f6a-4e04-96e8-94a19fd958d2" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.101079] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.101079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.101079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.101079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.101079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.101079] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 already deleted. [ 1005.101079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.101079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.101079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.101079] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.269763] env[65107]: INFO networking_nsxv3.common.synchronization [req-f8a1345a-c7de-4ce7-b88a-d664a3af1b5b req-7e21fa86-ca88-4e89-852f-2c6b2bd19edc tempest-SecurityGroupRulesTestJSON-1776800561 tempest-SecurityGroupRulesTestJSON-1776800561-project-member] Enqueued Resource ID: 51368af5-ca3c-4ddc-b2dd-ce09211055d4 with Priority: HIGHEST for action security_group_rules [ 1005.270037] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51368af5-ca3c-4ddc-b2dd-ce09211055d4 with Priority: HIGHEST for action security_group_rules [ 1005.270348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51368af5-ca3c-4ddc-b2dd-ce09211055d4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.270477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51368af5-ca3c-4ddc-b2dd-ce09211055d4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.270591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51368af5-ca3c-4ddc-b2dd-ce09211055d4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.270802] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51368af5-ca3c-4ddc-b2dd-ce09211055d4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.270908] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51368af5-ca3c-4ddc-b2dd-ce09211055d4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.623157] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.623463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.623463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.623841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.624009] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.624129] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 already deleted. [ 1005.624257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.666883] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 in Status: SUCCESS [ 1005.667482] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff45994-1b33-49a8-9e8d-d4e639f2b297 deletion is rescheduled due to dependency. [ 1005.667482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff45994-1b33-49a8-9e8d-d4e639f2b297" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.792760] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.792980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.792980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.793232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.793324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.793420] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51368af5-ca3c-4ddc-b2dd-ce09211055d4 already deleted. [ 1005.793569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51368af5-ca3c-4ddc-b2dd-ce09211055d4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.282098] env[65107]: INFO networking_nsxv3.common.synchronization [req-24b4f02b-d70b-4f97-84ce-474bf00ff007 req-a84f455e-315a-48e6-afa7-5438bfba0712 tempest-SecurityGroupRulesTestJSON-1776800561 tempest-SecurityGroupRulesTestJSON-1776800561-project-member] Enqueued Resource ID: f9e036aa-e13d-494d-abbb-6f331552b467 with Priority: HIGHEST for action security_group_rules [ 1006.282504] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e036aa-e13d-494d-abbb-6f331552b467 with Priority: HIGHEST for action security_group_rules [ 1006.282821] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e036aa-e13d-494d-abbb-6f331552b467 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.283028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e036aa-e13d-494d-abbb-6f331552b467" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.283028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e036aa-e13d-494d-abbb-6f331552b467" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.283265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e036aa-e13d-494d-abbb-6f331552b467" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.283332] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e036aa-e13d-494d-abbb-6f331552b467',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.777584] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1006.777584] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 deletion is rescheduled due to dependency. [ 1006.777584] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.803306] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.803452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.803452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.804018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.804018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.804018] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e036aa-e13d-494d-abbb-6f331552b467 already deleted. [ 1006.804018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e036aa-e13d-494d-abbb-6f331552b467" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.881535] env[65107]: INFO networking_nsxv3.common.synchronization [req-11dd1f26-0f21-44ae-b3b1-1a8e88ecd366 req-b1826954-0024-447f-8df4-4052f4a0e14f tempest-SecurityGroupRulesTestJSON-1776800561 tempest-SecurityGroupRulesTestJSON-1776800561-project-member] Enqueued Resource ID: 1423e07c-c253-471e-8304-be4e1ad0f80a with Priority: HIGHEST for action security_group_rules [ 1006.882972] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1423e07c-c253-471e-8304-be4e1ad0f80a with Priority: HIGHEST for action security_group_rules [ 1006.882972] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1423e07c-c253-471e-8304-be4e1ad0f80a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.882972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.882972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.883160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.883438] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1423e07c-c253-471e-8304-be4e1ad0f80a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.011664] env[65107]: INFO networking_nsxv3.common.synchronization [req-3aa86eaa-30b5-421b-b7b1-20ca2c991e5c req-bdcdea29-b437-4416-8c53-f650623c0239 tempest-SecurityGroupRulesTestJSON-1776800561 tempest-SecurityGroupRulesTestJSON-1776800561-project-member] Enqueued Resource ID: 1423e07c-c253-471e-8304-be4e1ad0f80a with Priority: HIGHEST for action security_group_rules [ 1007.011720] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1423e07c-c253-471e-8304-be4e1ad0f80a with Priority: HIGHEST for action security_group_rules [ 1007.012020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1423e07c-c253-471e-8304-be4e1ad0f80a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.012169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.181649] env[65107]: INFO networking_nsxv3.common.synchronization [req-c3a19218-eb6f-46dd-af03-832640b1f338 req-957867cd-9421-40cc-a407-fc31895f30a9 tempest-SecurityGroupRulesTestJSON-1776800561 tempest-SecurityGroupRulesTestJSON-1776800561-project-member] Enqueued Resource ID: 1423e07c-c253-471e-8304-be4e1ad0f80a with Priority: HIGHEST for action security_group_rules [ 1007.182234] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1423e07c-c253-471e-8304-be4e1ad0f80a with Priority: HIGHEST for action security_group_rules [ 1007.182545] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1423e07c-c253-471e-8304-be4e1ad0f80a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.182814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.404192] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.404192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.404192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.404436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.404436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.404502] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1423e07c-c253-471e-8304-be4e1ad0f80a already deleted. [ 1007.404563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.404705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.404863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.404945] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1423e07c-c253-471e-8304-be4e1ad0f80a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.925630] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.926038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.926038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.926038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.926154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.926244] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1423e07c-c253-471e-8304-be4e1ad0f80a already deleted. [ 1007.926287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.926417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.926561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.926647] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1423e07c-c253-471e-8304-be4e1ad0f80a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.995341] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1007.995466] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent loop - iteration:2 started [ 1008.451974] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.452258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.452343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.452581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.452671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.452768] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1423e07c-c253-471e-8304-be4e1ad0f80a already deleted. [ 1008.452854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1423e07c-c253-471e-8304-be4e1ad0f80a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.450629] env[65107]: INFO networking_nsxv3.common.synchronization [None req-6e5ee97f-e8e5-45c3-a51a-e8700ad86885 tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 7ee74259-4838-48a2-b224-7a9a808282fa with Priority: HIGHEST for action security_group_rules [ 1009.451315] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee74259-4838-48a2-b224-7a9a808282fa with Priority: HIGHEST for action security_group_rules [ 1009.451518] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ee74259-4838-48a2-b224-7a9a808282fa taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.451642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.451709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.451967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.452570] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ee74259-4838-48a2-b224-7a9a808282fa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.485463] env[65107]: INFO networking_nsxv3.common.synchronization [req-fa71d3ad-25ff-40bd-9a93-845c7932183e req-c18874f7-98fa-419d-86f3-e0aa9504e563 tempest-ListServerFiltersTestJSON-2098391239 tempest-ListServerFiltersTestJSON-2098391239-project-member] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 1009.485961] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 1009.486864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.486864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.486864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.487237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.488065] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.488065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.488065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.488065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.488065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.488065] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.743628] env[65107]: INFO networking_nsxv3.common.synchronization [None req-2b88631d-af68-4344-8da3-9ea98fb801c2 tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 7ee74259-4838-48a2-b224-7a9a808282fa with Priority: HIGHEST for action security_group_rules [ 1009.744374] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee74259-4838-48a2-b224-7a9a808282fa with Priority: HIGHEST for action security_group_rules [ 1009.744882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ee74259-4838-48a2-b224-7a9a808282fa taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.744882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.973579] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.973757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.973824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.974100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.974194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.974267] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ee74259-4838-48a2-b224-7a9a808282fa already deleted. [ 1009.974352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.974506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.974709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.974777] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ee74259-4838-48a2-b224-7a9a808282fa',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.990814] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.493269] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.510664] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.510664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.510664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.510664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.510664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.510664] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ee74259-4838-48a2-b224-7a9a808282fa already deleted. [ 1010.510664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ee74259-4838-48a2-b224-7a9a808282fa" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.942521] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.942684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.942753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.942969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.943173] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.996391] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.996391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.996391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.996785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.996785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.997751] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 1011.026932] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.027162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.027162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.027399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.027552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.038898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 1011.446699] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.949021] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.097595] env[65107]: INFO networking_nsxv3.common.synchronization [None req-24ce8ed9-aac8-45e9-a272-f0849b79ff0f None None] Enqueued Resource ID: f42c6c6f-4b18-4035-880b-9e7a6da51f46 with Priority: HIGHEST for action port [ 1012.097952] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f42c6c6f-4b18-4035-880b-9e7a6da51f46 with Priority: HIGHEST for action port [ 1012.098223] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f42c6c6f-4b18-4035-880b-9e7a6da51f46 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.098359] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f42c6c6f-4b18-4035-880b-9e7a6da51f46" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.098628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f42c6c6f-4b18-4035-880b-9e7a6da51f46" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.098812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f42c6c6f-4b18-4035-880b-9e7a6da51f46" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.098907] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42c6c6f-4b18-4035-880b-9e7a6da51f46',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.415728] env[65107]: INFO networking_nsxv3.common.synchronization [req-50f1b304-3e13-4f13-8b2f-e465b75544d7 req-530b9b0a-6988-437d-be70-55334bf5d824 tempest-ServersNegativeTestJSON-35009868 tempest-ServersNegativeTestJSON-35009868-project-member] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 1012.416783] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGHEST for action security_group_members [ 1012.416783] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.416783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.416783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.417587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.418057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.418178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.418242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.420786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.420944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.421108] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.451614] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1012.451848] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1012.601153] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f42c6c6f-4b18-4035-880b-9e7a6da51f46 [ 1012.602545] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.602545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.602545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.602545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.602545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.602545] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f42c6c6f-4b18-4035-880b-9e7a6da51f46 already deleted. [ 1012.602545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f42c6c6f-4b18-4035-880b-9e7a6da51f46" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.734882] env[65107]: INFO networking_nsxv3.common.synchronization [req-e04480ea-1d2d-4c46-943e-f4e4d3a889a5 req-5709a3c0-1bf6-40a0-8ef0-c2426ea71e03 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1012.738258] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1012.738258] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.738258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.738258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.738258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.738258] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.738258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.738258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.738258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.738258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.738258] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.825557] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7e223d56-6a6d-4fa5-8240-bf6893006f37 None None] Enqueued Resource ID: 75df6241-6f08-4d1d-8285-251005d91df9 with Priority: HIGHEST for action port [ 1012.825557] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75df6241-6f08-4d1d-8285-251005d91df9 with Priority: HIGHEST for action port [ 1012.825750] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-75df6241-6f08-4d1d-8285-251005d91df9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.825815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75df6241-6f08-4d1d-8285-251005d91df9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.825860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75df6241-6f08-4d1d-8285-251005d91df9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.829017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75df6241-6f08-4d1d-8285-251005d91df9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.829017] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75df6241-6f08-4d1d-8285-251005d91df9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.927028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.927028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.927028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.927028] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be updated. [ 1012.959875] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.959875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.960252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.960252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.960468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.970306] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: IN_PROGRESS for 2s [ 1013.056398] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 1013.056574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.129140] env[65107]: INFO networking_nsxv3.common.synchronization [req-36861292-a67a-4ca0-8e42-2680ed25bd4b req-20baf9e8-4c09-4fa7-8caa-4b328085ec2b tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_members [ 1013.129337] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_members [ 1013.129628] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.129754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.129824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.130476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.130476] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.130476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.130476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.130754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.130754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.130819] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.239477] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.320305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.320450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.320517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.320729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.344696] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1013.351306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.352781] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1013.354089] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75df6241-6f08-4d1d-8285-251005d91df9 [ 1013.354323] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.354438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.354506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.355450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.355557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.355651] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75df6241-6f08-4d1d-8285-251005d91df9 already deleted. [ 1013.355734] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75df6241-6f08-4d1d-8285-251005d91df9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.388706] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.388947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.388947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.389149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.402247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.402954] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1013.403063] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1013.407020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1013.531807] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.532056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.532526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.532526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.534809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.535059] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1013.566644] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.566945] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.567047] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.567259] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.567574] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.567672] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.567762] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.567954] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.568131] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.568309] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.568419] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.572036] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.572036] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.572036] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.572036] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.572036] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.586653] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.586840] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.586943] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.587138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.587448] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.587638] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.587791] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.588148] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.588280] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bacc34f3-5e06-43c6-b2b8-570c4b81cf08',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.628765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.628959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.628959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.629196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.629469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.629744] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1013.632824] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.632947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.633027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.633214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.633297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.633475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.633565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.633627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.633853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.633940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.634029] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 already deleted. [ 1013.634107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.705512] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.705743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.705743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.706708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.706708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.706708] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1013.706708] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6970c294-30ba-4814-9be8-ff7a47ecd5e8', '72f456f5-8ebf-4a3f-9abe-b5b8150be76b', '20dddc20-b178-4d49-afa2-bbeaf4630ee9', 'd2af66a0-d07a-4cd7-8b33-9e5aee256d06', '4a469b2f-9178-42b0-be36-f1370374e744', '75e345bd-70c9-42fe-b74a-676b7bf1ce7f', 'd5a9e810-a93e-4373-b821-f175316f25f4', '9937f05f-124d-494a-801f-dac861864434', '57ccc978-a1f0-4c03-8296-5acfbdaf68e4', 'cfc0215e-9e19-4ef1-8f09-6aafac54a47f', '6801a112-5684-487c-b713-b3fc340c09d5', 'a2cc3c5b-5d64-430b-ba1a-61805cb1246f', '5166db24-d7b9-43dd-8152-fa49fdb2e750', 'e2bd5d37-9901-465a-8751-6c1cb28889e3', 'ae0f0ae8-be00-4206-98a1-2e29bf816ffc', '1e0fcae7-5a9f-402b-a906-9fb515e356a3', 'cb36a1e8-ba8d-491f-8291-18b58f2dfd6e', '916be366-a55f-4f65-b259-ce2263c7c963', '8339c2c0-4975-4589-90b6-20ecd3100845', '78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9', '0b0e1e5d-6b69-4241-b187-86836e4d9086', 'c78203ee-b32f-401b-9764-682ada8423c6', '2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083', 'f472a668-4442-488d-936d-2a700ed0a421', 'ae409816-e898-46fe-b06e-b955dd9008ef', '9125373b-7375-4872-9f2e-c95f9102b178', 'ed87eef5-439b-4752-b6cf-ead13a28e49a', 'c79582fb-f77d-4ad5-82e7-7e6d22e686de', '84f1e2df-169e-4c48-af3a-0f40af269363', 'fcf6500c-0f04-40de-ab53-f85da7100112', '8d4a7699-28a9-417a-9e0b-bf15ce0027be', '9be39cfe-e706-4bf7-8816-70542b5cb472', '3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8', '4197bdde-e214-41a5-8235-df774396919e', '24eb74d4-e639-4e5a-b7df-49fe504362b3', 'd43e6dbc-45c8-476b-af04-082906b1ad4d', 'e382ab2d-f671-4098-ac12-6a8786603007', '3e3c6061-32c5-4c10-8da4-b1be3cb71a03', '560f9d77-f914-4f8b-bc22-1688e970b817', 'b72cb83d-eebb-4f22-9614-47f9c3d37d79', '11705357-9323-4e1c-bf51-81c8b975ee5d', 'b2882833-81aa-4338-b54e-9f9cd3047983', '8ff45994-1b33-49a8-9e8d-d4e639f2b297', '65c1ee26-a734-444a-b046-00bdd1cd350d', '814a62b8-5b9a-4a8b-96c6-18956744a0ed', 'a5c10011-beb4-47e7-8405-2bfc31ee7de0'} {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1013.706708] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1013.726029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.726243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.726243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.726398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.726478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.726592] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1013.726660] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1013.726721] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1013.743099] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.812078] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.812078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.812078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.812541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.813756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.814395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1013.814395] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1013.814395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1013.814395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1013.814593] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1013.814593] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGH for action security_group_rules [ 1013.814676] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGH for action security_group_rules [ 1013.814720] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGH for action security_group_rules [ 1013.814771] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGH for action security_group_rules [ 1013.814850] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGH for action security_group_rules [ 1013.814901] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGH for action security_group_rules [ 1013.814952] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGH for action security_group_rules [ 1013.814998] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGH for action security_group_rules [ 1013.815073] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGH for action security_group_rules [ 1013.815136] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGH for action security_group_rules [ 1013.815219] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGH for action security_group_rules [ 1013.815272] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGH for action security_group_rules [ 1013.815344] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGH for action security_group_rules [ 1013.815418] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGH for action security_group_rules [ 1013.815470] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGH for action security_group_rules [ 1013.815516] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGH for action security_group_rules [ 1013.815604] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGH for action security_group_rules [ 1013.816188] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGH for action security_group_rules [ 1013.816188] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGH for action security_group_rules [ 1013.816188] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGH for action security_group_rules [ 1013.816188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.090978] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.091342] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.091469] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.091840] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.092144] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.092334] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port bacc34f3-5e06-43c6-b2b8-570c4b81cf08 not found, creating... [ 1014.092701] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.092854] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.092996] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.093266] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.093445] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.093874] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.093970] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.094022] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.094232] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.094361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.094494] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: bacc34f3-5e06-43c6-b2b8-570c4b81cf08 is going to be created. [ 1014.116746] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.117013] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.117107] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.117512] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.117741] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.117971] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.130923] env[65107]: INFO networking_nsxv3.common.synchronization [None req-e2c8844a-68ef-4e66-8086-5d4ce49fa488 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1014.131877] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1014.131877] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGH for action security_group_rules [ 1014.132131] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 with Priority: HIGH for action security_group_rules [ 1014.132249] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9e810-a93e-4373-b821-f175316f25f4 with Priority: HIGH for action security_group_rules [ 1014.132377] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc with Priority: HIGH for action security_group_rules [ 1014.132480] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 with Priority: HIGH for action security_group_rules [ 1014.132745] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8339c2c0-4975-4589-90b6-20ecd3100845 with Priority: HIGH for action security_group_rules [ 1014.132745] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916be366-a55f-4f65-b259-ce2263c7c963 with Priority: HIGH for action security_group_rules [ 1014.132745] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGH for action security_group_rules [ 1014.133023] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 with Priority: HIGH for action security_group_rules [ 1014.133023] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 with Priority: HIGH for action security_group_rules [ 1014.133023] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGH for action security_group_rules [ 1014.133113] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGH for action security_group_rules [ 1014.133221] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6801a112-5684-487c-b713-b3fc340c09d5 with Priority: HIGH for action security_group_rules [ 1014.133337] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGH for action security_group_rules [ 1014.133399] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 with Priority: HIGH for action security_group_rules [ 1014.133476] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f with Priority: HIGH for action security_group_rules [ 1014.133566] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9937f05f-124d-494a-801f-dac861864434 with Priority: HIGH for action security_group_rules [ 1014.133744] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a469b2f-9178-42b0-be36-f1370374e744 with Priority: HIGH for action security_group_rules [ 1014.133825] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b with Priority: HIGH for action security_group_rules [ 1014.133921] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 with Priority: HIGH for action security_group_rules [ 1014.134626] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.134763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.134990] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.135100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.135160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.135353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.135435] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.136770] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.136884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.136958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.137698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.137817] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20dddc20-b178-4d49-afa2-bbeaf4630ee9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.138970] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5a9e810-a93e-4373-b821-f175316f25f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.139067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.139131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.141040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.141040] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5a9e810-a93e-4373-b821-f175316f25f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.141040] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.141040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.141040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.141040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.141040] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0f0ae8-be00-4206-98a1-2e29bf816ffc',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.142495] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.142495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.142495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.142495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.142495] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.143601] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8339c2c0-4975-4589-90b6-20ecd3100845 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.143831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.143914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.144160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.144206] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8339c2c0-4975-4589-90b6-20ecd3100845',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.145684] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916be366-a55f-4f65-b259-ce2263c7c963 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.145684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.146801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.146801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.146801] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916be366-a55f-4f65-b259-ce2263c7c963',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.146801] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.146801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.146998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.146998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.147085] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.148731] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bd5d37-9901-465a-8751-6c1cb28889e3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.148731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.148731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.148731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.148939] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bd5d37-9901-465a-8751-6c1cb28889e3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.150399] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.150399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.150542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.150608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.150678] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e0fcae7-5a9f-402b-a906-9fb515e356a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.151839] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.151948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.152025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.152172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.152245] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.153129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.153237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.153322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.153459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.153494] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.154898] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6801a112-5684-487c-b713-b3fc340c09d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.155083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.155167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.155387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.155387] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6801a112-5684-487c-b713-b3fc340c09d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.156598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.156598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.156598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.156777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.156777] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.158825] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.158825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.158825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.158825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.158825] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ccc978-a1f0-4c03-8296-5acfbdaf68e4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.160052] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.160052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.160052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.160052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.160052] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e345bd-70c9-42fe-b74a-676b7bf1ce7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.160695] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9937f05f-124d-494a-801f-dac861864434 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.161163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.161234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.161383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.161457] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9937f05f-124d-494a-801f-dac861864434',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.162545] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a469b2f-9178-42b0-be36-f1370374e744 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.162647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.162875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.162875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.162970] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a469b2f-9178-42b0-be36-f1370374e744',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.163989] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.164100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.164170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.164376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.164415] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f456f5-8ebf-4a3f-9abe-b5b8150be76b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.165035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.165139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.165203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.165345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.165414] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2af66a0-d07a-4cd7-8b33-9e5aee256d06',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.190842] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.190990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.191117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.191445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.213186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.213374] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0f0ae8-be00-4206-98a1-2e29bf816ffc is going to be deleted. [ 1014.245492] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.245725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.245812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.246150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.246362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.246520] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1014.280901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.281099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.281148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.281444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.281605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.281605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0f0ae8-be00-4206-98a1-2e29bf816ffc" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.300798] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.300972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.301065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.301403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.301782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.319496] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1014.639042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.639042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.639042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.639042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.639042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.639042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.639042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.639042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.639422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.639422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.639422] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.655631] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.655631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.655631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.655889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.655889] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.656108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.656207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.656391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.656512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.656627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.656745] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.658767] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.659714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.659814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.660131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.660203] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.660291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.660362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.660509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.660972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.660972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.660972] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.664082] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.664276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.664346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.664536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.666533] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.666533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.674215] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.674505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.675141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.675141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.675141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.675141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.675369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.675531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.675531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.675665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.675791] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.682348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.682587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.682732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.683019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.683247] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.683357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.684041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.684129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.684258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.684456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.684456] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.695536] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.700141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.700141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.702074] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.702365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.712970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.712970] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20dddc20-b178-4d49-afa2-bbeaf4630ee9 is going to be deleted. [ 1014.722791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.722953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.727975] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.728182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.731224] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.731390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.732521] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.732684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.734026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.734209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.735398] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.735398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.736428] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.736563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.737290] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.737422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.739162] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.739162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.743156] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.743377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.744301] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1014.744755] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.745017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.747462] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1014.749478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.749478] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9 is going to be deleted. [ 1014.749478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.749478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.769102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.769102] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 is going to be deleted. [ 1014.769897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.770222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.773826] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0042a612-7872-465f-ac9c-3ad0cf798aa7 None None] Enqueued Resource ID: 9c44f006-e75d-444c-a04f-07ef7dd198f1 with Priority: HIGHEST for action port [ 1014.774900] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c44f006-e75d-444c-a04f-07ef7dd198f1 with Priority: HIGHEST for action port [ 1014.775294] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c44f006-e75d-444c-a04f-07ef7dd198f1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.775430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c44f006-e75d-444c-a04f-07ef7dd198f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.775501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c44f006-e75d-444c-a04f-07ef7dd198f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.775761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c44f006-e75d-444c-a04f-07ef7dd198f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.775853] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c44f006-e75d-444c-a04f-07ef7dd198f1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.786136] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.786136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.797128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.798560] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e0fcae7-5a9f-402b-a906-9fb515e356a3 is going to be deleted. [ 1014.799577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.799773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.803257] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.803257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.828350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.828523] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8339c2c0-4975-4589-90b6-20ecd3100845 is going to be deleted. [ 1014.829391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.829617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.832418] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.832418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.847338] env[65107]: INFO networking_nsxv3.common.synchronization [req-36861292-a67a-4ca0-8e42-2680ed25bd4b req-22319b54-9843-41d9-b8ea-38c77bc611f6 service nova] Enqueued Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_rules [ 1014.847583] env[65107]: INFO networking_nsxv3.common.synchronization [req-36861292-a67a-4ca0-8e42-2680ed25bd4b req-22319b54-9843-41d9-b8ea-38c77bc611f6 service nova] Enqueued Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_members [ 1014.847662] env[65107]: INFO networking_nsxv3.common.synchronization [req-36861292-a67a-4ca0-8e42-2680ed25bd4b req-22319b54-9843-41d9-b8ea-38c77bc611f6 service nova] Enqueued Resource ID: bacc34f3-5e06-43c6-b2b8-570c4b81cf08 with Priority: HIGHEST for action port [ 1014.848895] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_rules [ 1014.848895] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_members [ 1014.848895] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bacc34f3-5e06-43c6-b2b8-570c4b81cf08 with Priority: HIGHEST for action port [ 1014.849077] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.851357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.851409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.851670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.851759] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.852970] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.853101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.853101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.853291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.853421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.853503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.853558] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.853794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.856571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.856571] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.856571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.856571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.856571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.857317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.857317] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bacc34f3-5e06-43c6-b2b8-570c4b81cf08',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.877781] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.877781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.878783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.878899] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5a9e810-a93e-4373-b821-f175316f25f4 is going to be deleted. [ 1014.881659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.882431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.918388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.919585] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2af66a0-d07a-4cd7-8b33-9e5aee256d06 is going to be deleted. [ 1014.920580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.920807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.951838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.952030] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a469b2f-9178-42b0-be36-f1370374e744 is going to be deleted. [ 1014.952907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.953431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.992431] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 in Status: SUCCESS [ 1014.992431] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bd5d37-9901-465a-8751-6c1cb28889e3 deletion is rescheduled due to dependency. [ 1014.992431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.001153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.001285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.012770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.012908] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f456f5-8ebf-4a3f-9abe-b5b8150be76b is going to be deleted. [ 1015.013974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.014220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.018111] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.018252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.020387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.020502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.036154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.036895] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916be366-a55f-4f65-b259-ce2263c7c963 is going to be deleted. [ 1015.037236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.037408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.092534] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.094491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.107236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.107455] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ccc978-a1f0-4c03-8296-5acfbdaf68e4 is going to be deleted. [ 1015.108653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.109060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.130287] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.130418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.143165] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.143257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.143304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.143535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.143758] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.143879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.143941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.144133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.144472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.144472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.144472] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.144598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.144634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.144823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.145045] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.145157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.145229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.145373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.145452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.145532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.145622] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.162108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.162259] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6801a112-5684-487c-b713-b3fc340c09d5 is going to be deleted. [ 1015.163257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.163472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.168389] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.168486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.168486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.168704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.168867] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.168973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.169050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.169205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.169291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.169379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.169765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.169933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.169981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.170151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.170298] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.170390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.170451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.170587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.170663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.170745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.170897] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.178885] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.195478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.195635] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9937f05f-124d-494a-801f-dac861864434 is going to be deleted. [ 1015.196751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.197050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.199266] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.204174] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.204174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.204174] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb36a1e8-ba8d-491f-8291-18b58f2dfd6e: rpc.has_security_group_logging(os_id): False [ 1015.231506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.231506] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e345bd-70c9-42fe-b74a-676b7bf1ce7f is going to be deleted. [ 1015.232256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.233526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.233526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.233526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20dddc20-b178-4d49-afa2-bbeaf4630ee9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.233526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.233526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.233526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.233526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f7c22e-9b1e-4b9e-9ba1-bd9279a4d1e9" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.233957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.234120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.234576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.234576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bd5d37-9901-465a-8751-6c1cb28889e3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.234576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.234576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.234754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.234754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e0fcae7-5a9f-402b-a906-9fb515e356a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.234846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.234978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.235064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.235177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8339c2c0-4975-4589-90b6-20ecd3100845" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.235296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.235431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.235601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.235601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5a9e810-a93e-4373-b821-f175316f25f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.235731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.235998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.236376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.236376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2af66a0-d07a-4cd7-8b33-9e5aee256d06" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.236376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.236696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.236696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.236696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a469b2f-9178-42b0-be36-f1370374e744" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.236795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.236869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.236944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.237067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f456f5-8ebf-4a3f-9abe-b5b8150be76b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.237186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.237414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.237414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.237514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916be366-a55f-4f65-b259-ce2263c7c963" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.248472] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.248684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.248684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.249968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.276718] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.276948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.277293] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c44f006-e75d-444c-a04f-07ef7dd198f1 [ 1015.277511] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.277720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.277819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.278094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.279207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.279322] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c44f006-e75d-444c-a04f-07ef7dd198f1 already deleted. [ 1015.279435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c44f006-e75d-444c-a04f-07ef7dd198f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.288829] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.288829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.324326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.324670] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.324776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.324844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.325074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.325163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.325257] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e is going to be updated. [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ccc978-a1f0-4c03-8296-5acfbdaf68e4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.328303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6801a112-5684-487c-b713-b3fc340c09d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.338917] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.339083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.339421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.339421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.339652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.339652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9937f05f-124d-494a-801f-dac861864434" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.361056] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.361056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.361056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.361391] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bacc34f3-5e06-43c6-b2b8-570c4b81cf08 with status ACTIVE [ 1015.361739] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.361739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.361739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.361929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.361999] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.362212] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.362311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.362373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.362536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.362610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.362819] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.362883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.362920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.363061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.363134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.363216] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bacc34f3-5e06-43c6-b2b8-570c4b81cf08 is going to be updated. [ 1015.457705] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.457705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.457705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.457705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.457705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.457705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bacc34f3-5e06-43c6-b2b8-570c4b81cf08" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.512283] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.512283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.512283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.512283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.512283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.512283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e345bd-70c9-42fe-b74a-676b7bf1ce7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.544163] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1015.544840] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.545137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.545137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.545286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.545425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.597602] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: IN_PROGRESS for 2s [ 1015.649329] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6970c294-30ba-4814-9be8-ff7a47ecd5e8: rpc.has_security_group_logging(os_id): False [ 1015.673709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.673709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.673709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.673709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.674817] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cc3c5b-5d64-430b-ba1a-61805cb1246f: rpc.has_security_group_logging(os_id): False [ 1015.681533] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfc0215e-9e19-4ef1-8f09-6aafac54a47f: rpc.has_security_group_logging(os_id): False [ 1015.702087] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5166db24-d7b9-43dd-8152-fa49fdb2e750: rpc.has_security_group_logging(os_id): False [ 1015.705042] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.705254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.713089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.713435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.713583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.713583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.713837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.713924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.714180] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.714284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.714409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.714498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.714568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.714750] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.714859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.714920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.715081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.715193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.715284] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 1015.716536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.716707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.720056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.720273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.734244] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.734244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.742038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.742038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.742038] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.742038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.743039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.743039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.743039] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be updated. [ 1015.743039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.743039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.785070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.785435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.785540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.785607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.785862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.785953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.786074] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1015.787163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.788160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.822357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.822568] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.822733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.822809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.822966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.823044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.823165] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 is going to be updated. [ 1015.837333] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.837471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.838037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.838037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.838037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.859600] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.859771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.859842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.860066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.860234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.861402] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.862952] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 1015.877622] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.877724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.877780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.878023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.879132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.883998] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 1015.893686] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1015.941210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.941210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.941210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.941210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.941210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.959758] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: IN_PROGRESS for 2s [ 1015.979911] env[65107]: INFO networking_nsxv3.common.synchronization [None req-8f72bf1e-35b9-402b-95bc-6e409cbe7f2b None None] Enqueued Resource ID: 36d67b3a-9314-4f0f-93cb-b92969a08c92 with Priority: HIGHEST for action port [ 1015.981500] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36d67b3a-9314-4f0f-93cb-b92969a08c92 with Priority: HIGHEST for action port [ 1015.982434] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-36d67b3a-9314-4f0f-93cb-b92969a08c92 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.982592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36d67b3a-9314-4f0f-93cb-b92969a08c92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.982632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36d67b3a-9314-4f0f-93cb-b92969a08c92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.986402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36d67b3a-9314-4f0f-93cb-b92969a08c92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.986504] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d67b3a-9314-4f0f-93cb-b92969a08c92',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.164566] env[65107]: INFO networking_nsxv3.common.synchronization [req-0a3d7454-ad8d-48dc-be5d-f324c302a7e7 req-5c242fc7-e973-4faf-91d6-fa840121c254 tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1016.165856] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1016.165856] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.165856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.165856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.165856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.166110] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.167282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.167282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.167282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.167282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.167282] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.331191] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1016.331191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.331712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.332062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.332350] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.332587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.332771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.334025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.334025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.334025] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.365140] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.365322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.365453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.367061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.367061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.367061] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 is going to be created. [ 1016.391958] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.392127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.392394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.393136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.393818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.404555] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 in Status: UNINITIALIZED for 2s [ 1016.493571] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36d67b3a-9314-4f0f-93cb-b92969a08c92 [ 1016.493571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.493920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.493920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.495942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.496099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.496202] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36d67b3a-9314-4f0f-93cb-b92969a08c92 already deleted. [ 1016.496375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36d67b3a-9314-4f0f-93cb-b92969a08c92" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.576830] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.577099] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.577251] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.577703] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.578356] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.578356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.578356] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.578625] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.578937] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.579156] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.579274] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.579675] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.579675] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.579675] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.579818] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.579899] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.599554] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.599722] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.599869] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.600045] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.600366] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-36874049-8bd3-48d5-b662-4502dfbf61f0 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.600562] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.600675] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.601021] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.601158] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36874049-8bd3-48d5-b662-4502dfbf61f0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.669970] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.669970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.669970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.670328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.694130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.694130] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.694130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.694130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.694130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.694130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.694130] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1016.732258] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.732450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.732528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.732688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.732826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.742922] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1016.836275] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.836486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.836564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.836750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.867693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.868144] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.868334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.868400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.869047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.869047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.869047] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1016.898566] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.898779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.898779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.898966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.899151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.909173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1017.103953] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.106707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.106898] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.107193] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.107347] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.107505] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 36874049-8bd3-48d5-b662-4502dfbf61f0 not found, creating... [ 1017.107866] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.108046] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.108140] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.108365] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.109071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.109071] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.109071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.109326] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.109435] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.109494] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.109629] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 36874049-8bd3-48d5-b662-4502dfbf61f0 is going to be created. [ 1017.132114] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.132419] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.132498] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.132986] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.132986] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.133884] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.620327] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: SUCCESS [ 1017.620327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.648445] env[65107]: INFO networking_nsxv3.common.synchronization [req-dede6039-bfbb-42d7-ac53-1c0694b4e9f3 req-997c1f4c-9e8b-4668-a268-5d33565343da tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_members [ 1017.648724] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65c1ee26-a734-444a-b046-00bdd1cd350d with Priority: HIGHEST for action security_group_members [ 1017.649135] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65c1ee26-a734-444a-b046-00bdd1cd350d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.649329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.649387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.649662] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.649854] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.650026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.650026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.650233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.650310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.650372] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65c1ee26-a734-444a-b046-00bdd1cd350d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.845152] env[65107]: INFO networking_nsxv3.common.synchronization [req-0a3d7454-ad8d-48dc-be5d-f324c302a7e7 req-840abef2-92d9-49f4-8dcf-1a846bf806c6 service nova] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_rules [ 1017.845332] env[65107]: INFO networking_nsxv3.common.synchronization [req-0a3d7454-ad8d-48dc-be5d-f324c302a7e7 req-840abef2-92d9-49f4-8dcf-1a846bf806c6 service nova] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1017.845466] env[65107]: INFO networking_nsxv3.common.synchronization [req-0a3d7454-ad8d-48dc-be5d-f324c302a7e7 req-840abef2-92d9-49f4-8dcf-1a846bf806c6 service nova] Enqueued Resource ID: 36874049-8bd3-48d5-b662-4502dfbf61f0 with Priority: HIGHEST for action port [ 1017.845942] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_rules [ 1017.846267] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1017.849272] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36874049-8bd3-48d5-b662-4502dfbf61f0 with Priority: HIGHEST for action port [ 1017.849272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.849272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.849272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.849272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.849272] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.849272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.849272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.849272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-36874049-8bd3-48d5-b662-4502dfbf61f0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.849873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.849873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.849873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.849873] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36874049-8bd3-48d5-b662-4502dfbf61f0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.880086] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 1017.880317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.896357] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 1017.896576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.904699] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1017.905108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.974011] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: SUCCESS [ 1017.974235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.094959] env[65107]: INFO networking_nsxv3.common.synchronization [req-45e25445-2be3-4225-8cf9-fe8c186d551e req-de8d5fff-bddc-4c4f-bd1c-b2f063163694 tempest-ListServerFiltersTestJSON-2098391239 tempest-ListServerFiltersTestJSON-2098391239-project-member] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 1018.094959] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 1018.096102] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.096232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.096292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.096513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.096733] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.097512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.097579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.097757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.097848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.097948] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.152506] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.152733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.152733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.152988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.174156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.174156] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.174413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.174413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.174984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.174984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.174984] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c1ee26-a734-444a-b046-00bdd1cd350d is going to be updated. [ 1018.208603] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.208603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.208603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.208603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.208603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.218250] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c1ee26-a734-444a-b046-00bdd1cd350d in Status: IN_PROGRESS for 2s [ 1018.353179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.353327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.353526] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36874049-8bd3-48d5-b662-4502dfbf61f0 with status ACTIVE [ 1018.353767] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.353901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.353971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.354209] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.354333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.354484] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.354581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.354644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.354834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.354918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.355128] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.355216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.357929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.357929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.357929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.357929] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36874049-8bd3-48d5-b662-4502dfbf61f0 is going to be updated. [ 1018.385442] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.385601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.385674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.386218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.386365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.386608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36874049-8bd3-48d5-b662-4502dfbf61f0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.416558] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 in Status: SUCCESS [ 1018.416779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.416946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.417178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.417381] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.417482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.417618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.417758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.417842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.417940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.418025] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.600088] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.753546] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1018.753890] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 deletion is rescheduled due to dependency. [ 1018.753952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.754086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.754295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.754475] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.754591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.754658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.754835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.754942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.755071] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.920715] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1018.921054] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed deletion is rescheduled due to dependency. [ 1018.921252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.923920] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.104293] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.257116] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.428050] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65db01b4-9be5-4612-9e1c-a336eb7f22d1: rpc.has_security_group_logging(os_id): False [ 1019.446033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.446188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.446252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.446966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.446966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.446966] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.446966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.447250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.447250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.447250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.447449] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 is going to be created. [ 1019.510945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.511150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.511150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.511363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.511560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.526116] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 in Status: IN_PROGRESS for 2s [ 1019.607575] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.607733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.607805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.608052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.608150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.608248] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 1019.647101] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.647101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.647101] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.647344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.647504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.658674] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 1019.760971] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.229037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65c1ee26-a734-444a-b046-00bdd1cd350d in Status: SUCCESS [ 1020.229267] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65c1ee26-a734-444a-b046-00bdd1cd350d deletion is rescheduled due to dependency. [ 1020.229368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65c1ee26-a734-444a-b046-00bdd1cd350d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.263375] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.265355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.265467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.265712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.265820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.265925] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1020.303031] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.303031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.303031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.303031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.303031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.314763] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1020.669023] env[65107]: INFO networking_nsxv3.common.synchronization [req-9de1a28b-262e-4e77-94c5-ef4e7eeecf56 req-24f8b737-9157-4f50-bba3-6375c77d8bb7 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1020.669023] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1020.669023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.673112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.673112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.673112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.673112] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.673112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.673112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.673112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.673112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.673112] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.056929] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.057278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.057278] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.057586] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.058369] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.059166] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.059166] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.059166] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.059166] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.059570] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.059614] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.061262] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.061262] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.061262] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.061262] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.061262] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.087972] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.087972] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.088860] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.088860] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.088860] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-ccc3647b-99d1-4eb5-af30-b64d10b29aed taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.089462] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.089607] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.090183] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.090387] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc3647b-99d1-4eb5-af30-b64d10b29aed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.173439] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.173601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.173601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.174535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.174535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.174535] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.174535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.174535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.174834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.174834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.174834] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 already deleted. [ 1021.174834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.539837] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 in Status: SUCCESS [ 1021.540071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.593970] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.594280] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.594399] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.594774] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.594961] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.595151] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port ccc3647b-99d1-4eb5-af30-b64d10b29aed not found, creating... [ 1021.595493] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.595673] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.595814] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.596119] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.596323] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.596637] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.596796] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.596910] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.597191] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.597329] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.597471] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: ccc3647b-99d1-4eb5-af30-b64d10b29aed is going to be created. [ 1021.620308] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.620505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.620646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.620928] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.621194] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.621436] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.668680] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 1021.668680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.324065] env[65107]: INFO networking_nsxv3.common.synchronization [req-9de1a28b-262e-4e77-94c5-ef4e7eeecf56 req-02668fd2-617d-4709-8c9f-46cde3847e43 service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1022.324476] env[65107]: INFO networking_nsxv3.common.synchronization [req-9de1a28b-262e-4e77-94c5-ef4e7eeecf56 req-02668fd2-617d-4709-8c9f-46cde3847e43 service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1022.324476] env[65107]: INFO networking_nsxv3.common.synchronization [req-9de1a28b-262e-4e77-94c5-ef4e7eeecf56 req-02668fd2-617d-4709-8c9f-46cde3847e43 service nova] Enqueued Resource ID: ccc3647b-99d1-4eb5-af30-b64d10b29aed with Priority: HIGHEST for action port [ 1022.325226] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1022.325336] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1022.325459] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc3647b-99d1-4eb5-af30-b64d10b29aed with Priority: HIGHEST for action port [ 1022.325747] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.325871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.326077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.326451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.326557] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.327443] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.327555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.327630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.327789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.328542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.328542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.328542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.328542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.328542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.328542] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.329158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccc3647b-99d1-4eb5-af30-b64d10b29aed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.329262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.329618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.329618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.329618] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc3647b-99d1-4eb5-af30-b64d10b29aed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.330990] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1022.331213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.332435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.332435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.332435] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.332435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.332435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.332435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.333462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.333462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.333462] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.831773] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.832860] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.832993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.834693] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccc3647b-99d1-4eb5-af30-b64d10b29aed with status ACTIVE [ 1022.834785] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.834872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.834917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.835918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.835918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.835918] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.835918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.835918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.835918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.835918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.835918] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.836345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.836345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.836345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.836345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.836345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccc3647b-99d1-4eb5-af30-b64d10b29aed is going to be updated. [ 1022.837561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.837691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.837753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.838073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.838073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.838252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.838252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.838349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.840059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.840059] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.840059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.840059] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.862032] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.862797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.862797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.862797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.862797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.862797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccc3647b-99d1-4eb5-af30-b64d10b29aed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.020372] env[65107]: INFO networking_nsxv3.common.synchronization [req-3a39004f-7424-4395-a8c7-7b45a3aa5a86 req-5d583669-8fb5-4225-b060-889783649925 tempest-InstanceActionsV221TestJSON-943345222 tempest-InstanceActionsV221TestJSON-943345222-project-member] Enqueued Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_members [ 1023.021655] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_members [ 1023.022046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd72c5b5-c134-476a-a735-5cb55328bc65 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.022490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.022490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.022607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.022752] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.022879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.022935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.023136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.023222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.023319] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.322223] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.322426] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.322547] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.322891] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.323178] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.323348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.323489] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.323805] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.323951] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.324169] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.324409] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.324409] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.324482] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.324572] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.324710] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.324841] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.334683] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.342356] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24eb74d4-e639-4e5a-b7df-49fe504362b3: rpc.has_security_group_logging(os_id): False [ 1023.349164] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.349350] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.349489] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.349664] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-80" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.349990] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-d3668877-efc4-4479-83d8-68549210fb43 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.350184] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.350301] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.350646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.350762] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3668877-efc4-4479-83d8-68549210fb43',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.368115] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.368323] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.368376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.368560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.368653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.368863] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.368962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.369034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.369188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.369263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.369443] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.369534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.369594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.369727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.369803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.369974] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.370075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.370129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.370266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.370338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.370421] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1023.431516] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.431779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.431779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.432248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.432248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.448712] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1023.525561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.525713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.525779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.526016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.526112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.526314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.526402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.526463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.526615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.526691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.526777] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd72c5b5-c134-476a-a735-5cb55328bc65 already deleted. [ 1023.526856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.836994] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.837180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.837236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.837450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.837535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.837632] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be created. [ 1023.854280] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.854521] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.854646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.854914] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.855071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.855219] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port d3668877-efc4-4479-83d8-68549210fb43 not found, creating... [ 1023.855483] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.855631] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.855737] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.855964] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.856131] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.856410] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.856561] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.856674] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.856872] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.857014] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.857472] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: d3668877-efc4-4479-83d8-68549210fb43 is going to be created. [ 1023.864306] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.864500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.864500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.864688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.864830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.873090] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: UNINITIALIZED for 2s [ 1023.880140] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.880140] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.880271] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.880474] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.880692] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.880913] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.591897] env[65107]: INFO networking_nsxv3.common.synchronization [req-3a39004f-7424-4395-a8c7-7b45a3aa5a86 req-8e514bfe-b7bf-4d07-85f3-63f63cc9ce4e service nova] Enqueued Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_rules [ 1024.592248] env[65107]: INFO networking_nsxv3.common.synchronization [req-3a39004f-7424-4395-a8c7-7b45a3aa5a86 req-8e514bfe-b7bf-4d07-85f3-63f63cc9ce4e service nova] Enqueued Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_members [ 1024.592331] env[65107]: INFO networking_nsxv3.common.synchronization [req-3a39004f-7424-4395-a8c7-7b45a3aa5a86 req-8e514bfe-b7bf-4d07-85f3-63f63cc9ce4e service nova] Enqueued Resource ID: d3668877-efc4-4479-83d8-68549210fb43 with Priority: HIGHEST for action port [ 1024.593025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_rules [ 1024.593224] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_members [ 1024.593385] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3668877-efc4-4479-83d8-68549210fb43 with Priority: HIGHEST for action port [ 1024.593750] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd72c5b5-c134-476a-a735-5cb55328bc65 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.593885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.593961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.594265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.594375] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.595440] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd72c5b5-c134-476a-a735-5cb55328bc65 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.595577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.595653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.595844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.596043] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.596122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.596239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.596337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.596425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.596517] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.597725] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3668877-efc4-4479-83d8-68549210fb43 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.597843] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.597936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.598056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.598132] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3668877-efc4-4479-83d8-68549210fb43',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.099532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd72c5b5-c134-476a-a735-5cb55328bc65 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.099689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.101287] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3668877-efc4-4479-83d8-68549210fb43 with status ACTIVE [ 1025.101464] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.101608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.101694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.101906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.102008] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.102251] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.102338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.102380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.102551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.102626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.103387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.103387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.103387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.103387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.103387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.103387] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3668877-efc4-4479-83d8-68549210fb43 is going to be updated. [ 1025.105858] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.132050] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.132050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.132050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.132050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.132050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.132050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3668877-efc4-4479-83d8-68549210fb43" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.463887] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1025.464250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.607196] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.883216] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1025.883383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.883541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.883806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.883997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.884126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.884190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.884349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.884430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.884514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.884606] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.109476] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.109476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.109731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.109969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.110093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.110666] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd72c5b5-c134-476a-a735-5cb55328bc65 is going to be created. [ 1026.159558] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.159840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.159840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.160124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.160328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.182138] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd72c5b5-c134-476a-a735-5cb55328bc65 in Status: UNINITIALIZED for 2s [ 1026.387124] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.387282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.387333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.387556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.387770] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.387925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.387925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.388131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.388575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.388643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.388814] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.388893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.389025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.389135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.389285] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.389378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.389431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.389573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.389654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.389739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.389830] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.892161] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c066e724-cbaf-469e-be19-001bda52a5c7: rpc.has_security_group_logging(os_id): False [ 1026.911216] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.911411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.911473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.911748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.911833] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.912041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.912149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.912210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.912368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.912440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.912717] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.912717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.912840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.912925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.913016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.913216] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.913294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.913335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.913476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.913546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.913628] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be created. [ 1026.983128] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.983397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.983397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.983557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.983793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.999575] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1027.752312] env[65107]: INFO networking_nsxv3.common.synchronization [req-396987a1-cef5-4c56-8dbb-bb70d6521609 req-61de4ad7-b291-4cf3-9994-b8e050b1d35d tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1027.752312] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1027.752610] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.752736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.752804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.753426] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.753659] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.753796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.753897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.754037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.754794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.754794] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.882629] env[65107]: INFO networking_nsxv3.common.synchronization [None req-9538c9f6-b6dc-4084-923b-d24bfa7a2933 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1027.883248] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1027.883569] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.883721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.883948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.884393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.884484] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.968766] env[65107]: INFO networking_nsxv3.common.synchronization [None req-a53c01c8-0e6a-4a15-9ee9-367db9125e83 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1027.969287] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1027.969938] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.970071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.192632] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd72c5b5-c134-476a-a735-5cb55328bc65 in Status: SUCCESS [ 1028.192632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.192858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.192922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.193139] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.193289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.193355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.193541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.193662] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.193805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.193903] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.258088] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.258891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.258891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.258891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.258891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.259202] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.259202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.259202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.259344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.259424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.259518] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 1028.286537] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.286781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.286873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.287221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.287445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.297743] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 1028.407564] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.407760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.407820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.407991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.408142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.408243] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 already deleted. [ 1028.408328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.408509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.408674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.408757] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.696583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd72c5b5-c134-476a-a735-5cb55328bc65 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.696786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.696840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.697164] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.697440] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.697595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.697793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.697916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.698109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.698163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.698393] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd72c5b5-c134-476a-a735-5cb55328bc65 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.698522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.698522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.698682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.698855] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.698950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.699023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.699221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.699304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.699398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.699451] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.934757] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.934923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.934923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.935653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.935653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.935653] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 already deleted. [ 1028.935653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.013642] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1029.013642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.204856] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd72c5b5-c134-476a-a735-5cb55328bc65: rpc.has_security_group_logging(os_id): False [ 1029.225383] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.225683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.225683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.225995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.226250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.226507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.226778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.226778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.226927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.227110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.227429] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.227571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.227692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.227954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.227954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.228320] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.228443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.228516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.228625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.228737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.228837] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd72c5b5-c134-476a-a735-5cb55328bc65 is going to be created. [ 1029.305503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.305503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.305731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.306680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.306680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.326130] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd72c5b5-c134-476a-a735-5cb55328bc65 in Status: IN_PROGRESS for 2s [ 1030.307702] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 1030.308186] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 1030.308186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.331127] env[65107]: INFO networking_nsxv3.common.synchronization [req-ad2d4d1e-f5e7-480b-a0ad-c35aa0662417 req-0c6553ba-31d0-49fc-8697-508f4bc3c044 tempest-ListServerFiltersTestJSON-2098391239 tempest-ListServerFiltersTestJSON-2098391239-project-member] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 1031.332349] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGHEST for action security_group_members [ 1031.332653] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.332780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.332878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.333128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.333323] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.333479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.333627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.333916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.334124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.334403] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.347910] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd72c5b5-c134-476a-a735-5cb55328bc65 in Status: SUCCESS [ 1031.348463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.837661] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.837904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.838035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.839028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.867914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.868834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.868834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.868834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.868834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.868834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.868834] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be updated. [ 1031.900186] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.900334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.900412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.900599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.900777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.910782] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: IN_PROGRESS for 2s [ 1033.922968] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1e2df-169e-4c48-af3a-0f40af269363 in Status: SUCCESS [ 1033.922968] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 deletion is rescheduled due to dependency. [ 1033.923373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.034222] env[65107]: INFO networking_nsxv3.common.synchronization [req-a05dd86f-6b0a-4bf6-9c58-9e626f59f159 req-47daab78-3f9d-4883-b91a-e63159b12571 tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1034.035642] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1034.036139] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.036298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.036404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.036678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.036853] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.036958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.037040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.037218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.037345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.038898] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.393334] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.393334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.393526] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.393676] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.393955] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.394104] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.394216] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.394423] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.394612] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.394872] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.395078] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.395213] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.395316] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.395424] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.395529] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.395657] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.414487] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.414658] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.414791] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.414970] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-806" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.415351] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-4e070920-c550-42f7-afbc-c40bc606d7a0 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.415531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.415648] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.416011] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.416164] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e070920-c550-42f7-afbc-c40bc606d7a0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.539359] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.539873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.539970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.540237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.540343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.540567] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.540687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.540750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.540915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.541020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.541104] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 1034.571053] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.571214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.571350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.571859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.572071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.582244] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 1034.794597] env[65107]: INFO networking_nsxv3.common.synchronization [req-df784361-a335-4d28-9f89-b9469e20b5ce req-cd17e6b9-34b8-4cc1-b6ec-c33f0d1a114d tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1034.794788] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1034.795245] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.795365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.795365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.795539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.795695] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.795795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.795856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.796012] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.796104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.796198] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.918827] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.919043] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.919178] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.919462] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.919625] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.919779] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 4e070920-c550-42f7-afbc-c40bc606d7a0 not found, creating... [ 1034.920055] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.920214] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.920328] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.920542] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.920674] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.920952] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.921119] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.921233] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.921456] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.921596] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.921733] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 4e070920-c550-42f7-afbc-c40bc606d7a0 is going to be created. [ 1034.943481] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.943949] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.943997] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.944354] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.944613] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.944872] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.299218] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.299454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.299512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.299815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.299963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.300288] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.300443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.300552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.300791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.300923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.301076] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1035.338642] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.338878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.338878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.339086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.339223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.348927] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1035.709625] env[65107]: INFO networking_nsxv3.common.synchronization [req-a05dd86f-6b0a-4bf6-9c58-9e626f59f159 req-b3f0d6e4-2fed-4e59-ac74-551105ea6f1c service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 1035.710579] env[65107]: INFO networking_nsxv3.common.synchronization [req-a05dd86f-6b0a-4bf6-9c58-9e626f59f159 req-b3f0d6e4-2fed-4e59-ac74-551105ea6f1c service nova] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1035.710831] env[65107]: INFO networking_nsxv3.common.synchronization [req-a05dd86f-6b0a-4bf6-9c58-9e626f59f159 req-b3f0d6e4-2fed-4e59-ac74-551105ea6f1c service nova] Enqueued Resource ID: 4e070920-c550-42f7-afbc-c40bc606d7a0 with Priority: HIGHEST for action port [ 1035.711621] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_rules [ 1035.711892] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1035.712080] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e070920-c550-42f7-afbc-c40bc606d7a0 with Priority: HIGHEST for action port [ 1035.713267] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.713267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.713267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.713508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.713508] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.714757] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.714922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.715193] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e070920-c550-42f7-afbc-c40bc606d7a0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.715356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.715590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.715846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.716016] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e070920-c550-42f7-afbc-c40bc606d7a0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.888349] env[65107]: INFO networking_nsxv3.common.synchronization [req-b24151e3-e4e8-4aeb-adb8-445acb72d858 req-e16c2c9e-45fc-4504-949f-3af5af400719 tempest-InstanceActionsV221TestJSON-943345222 tempest-InstanceActionsV221TestJSON-943345222-project-member] Enqueued Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_members [ 1035.888947] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd72c5b5-c134-476a-a735-5cb55328bc65 with Priority: HIGHEST for action security_group_members [ 1035.889361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd72c5b5-c134-476a-a735-5cb55328bc65 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.889475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.889518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.889758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.889985] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.890129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.890288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.890470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.890588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.890705] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd72c5b5-c134-476a-a735-5cb55328bc65',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.217742] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.218242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.218242] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e070920-c550-42f7-afbc-c40bc606d7a0 with status ACTIVE [ 1036.218414] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.218414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.218498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.218675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.218759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.218946] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.219071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.219134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.219296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.219376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.219566] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.219659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.219718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.219957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.219957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.220070] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e070920-c550-42f7-afbc-c40bc606d7a0 is going to be updated. [ 1036.249271] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.249271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.249271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.249271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.249453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.249806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e070920-c550-42f7-afbc-c40bc606d7a0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.392560] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.392712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.392782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.393048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.393150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.393361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.393460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.393521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.393673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.393831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.393973] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd72c5b5-c134-476a-a735-5cb55328bc65 is going to be updated. [ 1036.425031] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.425031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.425031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.425031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.425031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.436926] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd72c5b5-c134-476a-a735-5cb55328bc65 in Status: IN_PROGRESS for 2s [ 1036.453208] env[65107]: INFO networking_nsxv3.common.synchronization [req-2defe3d3-698f-40cf-a7f0-b25390c48853 req-2b09fe9f-8a8b-4e9f-9274-7046eb8e4fe5 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1036.453719] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1036.454106] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.454225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.454336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.454554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.454712] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.454841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.454892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.455155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.455252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.455350] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.593507] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 1036.593906] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 1036.593906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.596291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.596545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.596740] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.596894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.596946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.597086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.597169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.597267] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.868442] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.868647] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.868769] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.869052] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.869317] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.869486] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.869608] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.869827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.869977] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.870312] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.870486] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.870626] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.870766] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.870909] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.871057] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.871226] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.890415] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.890580] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1036.890721] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.890899] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.891242] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.891413] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.891531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.891901] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.892057] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a66134-dfd2-4300-adec-0e22a2a1e6f6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.959745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.959975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.959975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.960204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.960320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.960527] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.960631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.960692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.960848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.960942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.961049] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 already deleted. [ 1036.961135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.100701] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.359521] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1037.359802] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1037.359857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.394889] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.395206] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.395344] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.395701] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.395877] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.396100] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port a4a66134-dfd2-4300-adec-0e22a2a1e6f6 not found, creating... [ 1037.396400] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.396562] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.396677] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.396981] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.397082] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.397373] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.397531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.397644] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.397846] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.397980] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.398292] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: a4a66134-dfd2-4300-adec-0e22a2a1e6f6 is going to be created. [ 1037.420291] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.420556] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.420763] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.421114] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.421404] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.421707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.604462] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.107806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.108040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.108040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.108936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.108936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.108936] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 1038.142570] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.142762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.142829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.143127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.144025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.157443] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 1038.246387] env[65107]: INFO networking_nsxv3.common.synchronization [req-2defe3d3-698f-40cf-a7f0-b25390c48853 req-88ae9abb-1fa2-499f-b840-255e7752eb31 service nova] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1038.247065] env[65107]: INFO networking_nsxv3.common.synchronization [req-2defe3d3-698f-40cf-a7f0-b25390c48853 req-88ae9abb-1fa2-499f-b840-255e7752eb31 service nova] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1038.247065] env[65107]: INFO networking_nsxv3.common.synchronization [req-2defe3d3-698f-40cf-a7f0-b25390c48853 req-88ae9abb-1fa2-499f-b840-255e7752eb31 service nova] Enqueued Resource ID: a4a66134-dfd2-4300-adec-0e22a2a1e6f6 with Priority: HIGHEST for action port [ 1038.248017] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1038.250287] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1038.250287] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a66134-dfd2-4300-adec-0e22a2a1e6f6 with Priority: HIGHEST for action port [ 1038.251187] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.251187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.251187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.251187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.251187] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.252788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.252919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.252996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.256029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.256029] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.256029] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.256029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.256029] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a66134-dfd2-4300-adec-0e22a2a1e6f6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.456660] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd72c5b5-c134-476a-a735-5cb55328bc65 in Status: SUCCESS [ 1038.456660] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd72c5b5-c134-476a-a735-5cb55328bc65 deletion is rescheduled due to dependency. [ 1038.456660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd72c5b5-c134-476a-a735-5cb55328bc65" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.553024] env[65107]: INFO networking_nsxv3.common.synchronization [req-1cdd258e-ba9c-4b56-88e2-a68786a56fcf req-1fb54f68-4292-4ca0-a20b-9b7fcde573b0 tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1038.556962] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1038.556962] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.556962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.556962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.557831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.558329] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.558670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.558917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.559321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.559600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.559982] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.758536] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.758776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.759052] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.760304] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4a66134-dfd2-4300-adec-0e22a2a1e6f6 with status ACTIVE [ 1038.760585] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.760755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.760878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.765142] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.765142] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.765142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.765142] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4a66134-dfd2-4300-adec-0e22a2a1e6f6 is going to be updated. [ 1038.793318] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.793318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.793318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.793318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.793318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.793680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4a66134-dfd2-4300-adec-0e22a2a1e6f6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.064023] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.064023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.064023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.064023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.064369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.064369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.064462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.064462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.064583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.064984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.064984] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1039.102374] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.102374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.102374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.102796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.103915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.114860] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1039.266701] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.770213] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.770813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.771051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.772244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.772360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.772483] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be created. [ 1039.802123] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.802364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.802417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.802648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.803050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.814538] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: UNINITIALIZED for 2s [ 1040.168489] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 1040.168757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.168982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.169232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.169427] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.169567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.169704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.169859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.169916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.169959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.170065] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.673102] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.673102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.673345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.673516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.673680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.673846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.673918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.674119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.674258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.674471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.674614] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.674722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.674804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.675056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.675219] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.675371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.675483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.675662] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.675753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.675871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.675973] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.127678] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1041.127678] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 deletion is rescheduled due to dependency. [ 1041.127678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.142684] env[65107]: INFO networking_nsxv3.common.synchronization [req-9af8a95a-26e9-48a3-9558-b3484500b4b6 req-7f57aa60-cad5-43f0-b9e3-9c818ce2a020 tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1041.142684] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1041.143075] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.143255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.143364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.144047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.144047] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.144047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.144047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.144308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.144350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.144438] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.178637] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6970c294-30ba-4814-9be8-ff7a47ecd5e8: rpc.has_security_group_logging(os_id): False [ 1041.203060] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.203291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.203371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.203599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.203689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.204285] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.204285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.204285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.204285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.204507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.204592] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.204707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.204812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.204976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.205071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.205265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.205359] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.205402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.205540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.205633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.205710] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 1041.304489] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.304683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.304762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.305230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.305529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.345341] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 1041.646926] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.647173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.647248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.647528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.671768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.672057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.672235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.672311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.672542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.672631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.672751] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1041.702304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.702508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.702586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.702743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.702932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.712541] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1041.825542] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: SUCCESS [ 1041.825777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.826200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.826488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.827091] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.827091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.827091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.827279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.827279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.827347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.827508] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.332203] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.834577] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14ef83a8-ad90-4c5e-987a-1f28536fa472: rpc.has_security_group_logging(os_id): False [ 1042.856680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.856928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.856928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.857141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.857240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.857512] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.857644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.857704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.857813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.857889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.857975] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be created. [ 1043.002570] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.002792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.002792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.002988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.003187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.015312] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: IN_PROGRESS for 2s [ 1043.365834] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 1043.365834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.725083] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1043.725674] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d deletion is rescheduled due to dependency. [ 1043.725942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.028110] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: SUCCESS [ 1045.028418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.144206] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1046.144206] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1047.746152] env[65107]: INFO networking_nsxv3.common.synchronization [req-5c560b1d-f868-4e5f-b097-fded0f60079c req-48afc560-1270-4748-80cf-4a3d5cbeb81c tempest-ServerDiskConfigTestJSON-346037325 tempest-ServerDiskConfigTestJSON-346037325-project-member] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1047.746152] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGHEST for action security_group_members [ 1047.747330] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.747330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.747330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.747635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.747635] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.747850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.747850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.747982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.748088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.748209] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.250590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.250777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.250821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.251169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.251311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.251547] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.251683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.251767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.251982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.252105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.252217] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be updated. [ 1048.281057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.281215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.281288] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.281504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.281644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.292447] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: IN_PROGRESS for 2s [ 1050.303483] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 in Status: SUCCESS [ 1050.303837] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 deletion is rescheduled due to dependency. [ 1050.303837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.515649] env[65107]: INFO networking_nsxv3.common.synchronization [req-7dfc6371-db1c-4bff-bd13-3358601c62d4 req-612f02b6-5931-47ef-8ca6-7cdc8764da3f tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_members [ 1050.516349] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGHEST for action security_group_members [ 1050.516613] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.516744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.516808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.517012] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.517186] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.517289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.517344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.517495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.517582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.517676] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.021069] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.021274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.021319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.021596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.021721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.022044] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.022229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.022289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.022456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.022556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.022771] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 is going to be updated. [ 1051.051387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.051539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.051665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.052031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.052231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.062553] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: IN_PROGRESS for 2s [ 1051.990437] env[65107]: INFO networking_nsxv3.common.synchronization [req-2354036a-2e4f-4a23-b6be-33d9d21d8c52 req-be47b8e9-506b-4e12-9a5c-70beb5420568 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1051.991094] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1051.991949] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.991949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.991949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.991949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.991949] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.992506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.992506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.992506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.992506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.992506] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.307782] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.307894] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.308081] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.308464] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.309059] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.309190] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.309812] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.309812] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.309812] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.310062] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.310062] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.310062] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.310181] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.310281] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.310385] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.310511] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.330221] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.330607] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.330607] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.330732] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.330989] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-22f5934f-693b-4d7b-8b11-628c0fd22e6f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.331190] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.331312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.331647] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.331783] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f5934f-693b-4d7b-8b11-628c0fd22e6f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.496414] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.496589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.496686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.496985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.497131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.497370] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.497485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.497549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.497706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.497783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.497871] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1052.524850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.525058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.525205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.525298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.525444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.535568] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1052.834598] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.834945] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.835042] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.835335] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.835500] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.835669] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 22f5934f-693b-4d7b-8b11-628c0fd22e6f not found, creating... [ 1052.835999] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.836249] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.836392] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.836646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.836802] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.837138] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.837317] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.837462] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.837710] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.837858] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.838042] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 22f5934f-693b-4d7b-8b11-628c0fd22e6f is going to be created. [ 1052.860507] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.860822] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.860899] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.861171] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.861486] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.861807] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.072725] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 in Status: SUCCESS [ 1053.073372] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 deletion is rescheduled due to dependency. [ 1053.073372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.583648] env[65107]: INFO networking_nsxv3.common.synchronization [req-2354036a-2e4f-4a23-b6be-33d9d21d8c52 req-7fb2405d-9d99-47b5-ace9-55f09a9a6397 service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1053.583889] env[65107]: INFO networking_nsxv3.common.synchronization [req-2354036a-2e4f-4a23-b6be-33d9d21d8c52 req-7fb2405d-9d99-47b5-ace9-55f09a9a6397 service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1053.584151] env[65107]: INFO networking_nsxv3.common.synchronization [req-2354036a-2e4f-4a23-b6be-33d9d21d8c52 req-7fb2405d-9d99-47b5-ace9-55f09a9a6397 service nova] Enqueued Resource ID: 22f5934f-693b-4d7b-8b11-628c0fd22e6f with Priority: HIGHEST for action port [ 1053.584651] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1053.584792] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1053.584909] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22f5934f-693b-4d7b-8b11-628c0fd22e6f with Priority: HIGHEST for action port [ 1053.585211] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.585334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.585402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.585619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.585708] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.587067] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.587190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.587398] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-22f5934f-693b-4d7b-8b11-628c0fd22e6f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.587501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.587566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.587731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.587807] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f5934f-693b-4d7b-8b11-628c0fd22e6f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.089655] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.090022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.090077] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22f5934f-693b-4d7b-8b11-628c0fd22e6f with status ACTIVE [ 1054.090265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.090377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.090438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.090710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.090817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.091012] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.091225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.091317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.091489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.091573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.091764] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.091879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.091936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.092058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.092137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.092219] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22f5934f-693b-4d7b-8b11-628c0fd22e6f is going to be updated. [ 1054.117856] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.118087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.118087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.118303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.118442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.118605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22f5934f-693b-4d7b-8b11-628c0fd22e6f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.260161] env[65107]: INFO networking_nsxv3.common.synchronization [req-29ba1796-2045-46f4-8895-9e85e4ca022f req-aa21d7f8-a49d-453a-9c62-af57e3509e92 tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1054.260161] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1054.260161] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.260716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.261449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.261449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.261624] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.261765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.261882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.261981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.262111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.262202] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.546833] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1054.547512] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1054.547512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.547512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.547512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.547701] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.547701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.547801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.547989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.548098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.548170] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.705542] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.705742] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.705890] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.706414] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.706686] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.706850] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.706970] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.707206] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.707352] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.707563] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.707674] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.707783] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.707890] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.707999] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.708118] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.708247] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.729687] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.729887] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.730026] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.730207] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-154" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.730520] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-94979a0c-24f2-495d-b5fd-b75f649d57d5 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.730819] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.730819] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.731272] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.731366] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94979a0c-24f2-495d-b5fd-b75f649d57d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.764719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.764913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.764995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.765237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.765327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.765513] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.765626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.765699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.765853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.765927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.766026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1054.794723] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.794879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.794959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.795230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.795375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.804831] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1055.052374] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.234574] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.235045] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.235045] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.235199] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.235349] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.235496] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 94979a0c-24f2-495d-b5fd-b75f649d57d5 not found, creating... [ 1055.235753] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.236019] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.236122] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.236348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.236481] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.236758] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.236910] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.237037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.237288] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.237423] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.237561] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 94979a0c-24f2-495d-b5fd-b75f649d57d5 is going to be created. [ 1055.259170] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.259375] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.259500] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.259766] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.260045] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.260279] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.557604] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.975569] env[65107]: INFO networking_nsxv3.common.synchronization [req-29ba1796-2045-46f4-8895-9e85e4ca022f req-24098d03-09f2-49da-917c-5f12d689c658 service nova] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_rules [ 1055.975834] env[65107]: INFO networking_nsxv3.common.synchronization [req-29ba1796-2045-46f4-8895-9e85e4ca022f req-24098d03-09f2-49da-917c-5f12d689c658 service nova] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1055.975834] env[65107]: INFO networking_nsxv3.common.synchronization [req-29ba1796-2045-46f4-8895-9e85e4ca022f req-24098d03-09f2-49da-917c-5f12d689c658 service nova] Enqueued Resource ID: 94979a0c-24f2-495d-b5fd-b75f649d57d5 with Priority: HIGHEST for action port [ 1055.976242] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_rules [ 1055.976379] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1055.976474] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94979a0c-24f2-495d-b5fd-b75f649d57d5 with Priority: HIGHEST for action port [ 1055.976954] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.976954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.976954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.977291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.977379] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.978715] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.978823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.979033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-94979a0c-24f2-495d-b5fd-b75f649d57d5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.979733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.979733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.979733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.979733] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94979a0c-24f2-495d-b5fd-b75f649d57d5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.058765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.059019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.059019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.059324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.059423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.059525] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1056.098529] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.098806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.098806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.099186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.099493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.118594] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1056.479448] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.479824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.481106] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94979a0c-24f2-495d-b5fd-b75f649d57d5 with status ACTIVE [ 1056.481463] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.481639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.481720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.482070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.482191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.482709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.482860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.482860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.483064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.483197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.483477] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.483537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.483573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.483732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.483814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.483974] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94979a0c-24f2-495d-b5fd-b75f649d57d5 is going to be updated. [ 1056.505975] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.506179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.506228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.506428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.506686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.506775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94979a0c-24f2-495d-b5fd-b75f649d57d5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.693820] env[65107]: INFO networking_nsxv3.common.synchronization [req-df085dd2-dc68-4759-8cc8-0629fb319395 req-5d6e36bc-83d6-4910-a822-d902047ea5ed tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1056.694463] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1056.694853] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.694955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.695000] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.695233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.695375] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.695474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.695535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.695683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.695768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.695863] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.816712] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1056.816976] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 deletion is rescheduled due to dependency. [ 1056.817124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.817303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.817672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.817758] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.817837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.817880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.818024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.818103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.818201] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.031817] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.032011] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.032142] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.032449] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.032706] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.032862] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.032978] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.033199] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.033343] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.033545] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.033654] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.033758] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.033890] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.034000] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.034115] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.034243] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.052458] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.052722] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.052885] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.053075] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.053390] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.053555] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.053670] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.054041] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.054180] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fc2cd5-eecc-43d6-951a-fba34bbdae34',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.197523] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.321163] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.557646] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.558071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.558071] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.558221] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.558369] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.558522] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port d8fc2cd5-eecc-43d6-951a-fba34bbdae34 not found, creating... [ 1057.558792] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.558953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.559086] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.559302] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.559439] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.559715] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.559868] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.559984] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.560276] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.560440] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.560621] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: d8fc2cd5-eecc-43d6-951a-fba34bbdae34 is going to be created. [ 1057.580568] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.580830] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.580977] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.581304] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.581553] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.581825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.699218] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.822623] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.135896] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1058.136232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.136603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.136742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.136994] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.137175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.137230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.137415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.137511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.137603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.137699] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.202560] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.202841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.202942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.203265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.203402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.203512] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be updated. [ 1058.238707] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.238864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.238971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.239364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.239572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.251812] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: IN_PROGRESS for 2s [ 1058.322922] env[65107]: INFO networking_nsxv3.common.synchronization [req-df085dd2-dc68-4759-8cc8-0629fb319395 req-306b4a9f-63dd-4d30-b1f9-7a7123583f6a service nova] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1058.323133] env[65107]: INFO networking_nsxv3.common.synchronization [req-df085dd2-dc68-4759-8cc8-0629fb319395 req-306b4a9f-63dd-4d30-b1f9-7a7123583f6a service nova] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1058.323276] env[65107]: INFO networking_nsxv3.common.synchronization [req-df085dd2-dc68-4759-8cc8-0629fb319395 req-306b4a9f-63dd-4d30-b1f9-7a7123583f6a service nova] Enqueued Resource ID: d8fc2cd5-eecc-43d6-951a-fba34bbdae34 with Priority: HIGHEST for action port [ 1058.323816] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_rules [ 1058.323968] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1058.324224] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8fc2cd5-eecc-43d6-951a-fba34bbdae34 with Priority: HIGHEST for action port [ 1058.324485] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.324607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.324667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.324918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.325012] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.326364] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.326450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.326678] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.326783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.326846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.327077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.327152] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fc2cd5-eecc-43d6-951a-fba34bbdae34',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.329716] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.329716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.329716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.329716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.329716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.329716] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1058.360715] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.360885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.360934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.361159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.361309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.380727] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1058.640482] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.640482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.640856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.640856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.640937] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.641041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.641108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.641262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.641352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.641439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.641592] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.641684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.641750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.642019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.642176] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.642272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.642333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.642474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.642552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.642636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.642726] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.830063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.830063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.831422] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8fc2cd5-eecc-43d6-951a-fba34bbdae34 with status ACTIVE [ 1058.831652] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.831775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.831885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.832130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.832252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.832460] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.832570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.832649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.832818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.832918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.833130] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.833249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.833310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.833448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.833553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.833680] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8fc2cd5-eecc-43d6-951a-fba34bbdae34 is going to be updated. [ 1058.854167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.854359] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.854406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.854633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.854794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.854986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8fc2cd5-eecc-43d6-951a-fba34bbdae34" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.144940] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c066e724-cbaf-469e-be19-001bda52a5c7: rpc.has_security_group_logging(os_id): False [ 1059.165068] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.165068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.165068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.165068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.165068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.165068] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.165812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.165812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.165812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.165812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.165812] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.166193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.166193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.166761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.166761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.166761] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.166761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.166761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.167024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.167024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.167024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1059.230472] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.230832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.230980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.231337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.231594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.245927] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1060.263719] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: IN_PROGRESS for 4s [ 1060.392020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.392020] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.392020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.392020] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.895584] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.895755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.895854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.896162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.896513] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.896513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.896513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.896903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.896903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.896903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.897055] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.897110] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.897208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.897323] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.897465] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.898399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.898989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.898989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.898989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.899222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.899222] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.288224] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1061.288798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.402241] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24eb74d4-e639-4e5a-b7df-49fe504362b3: rpc.has_security_group_logging(os_id): False [ 1061.423676] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.423933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.423933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.424222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.425090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.425412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.425544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.425610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.425821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.425927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.426330] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.426573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.426949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.427074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.427139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.427679] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.427679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.427852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.427997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.428574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.428574] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1061.498390] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.498664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.498840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.499120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.499368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.524427] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1062.276992] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: SUCCESS [ 1062.277242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.277416] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.277666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.277927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.278077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.278146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.278328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.278404] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.278504] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.741469] env[65107]: INFO networking_nsxv3.common.synchronization [req-9ee6a99b-8eb0-4212-a2c4-c281ec13ae58 req-a0643ab6-7463-4782-b53b-9700ba87660d tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1062.742076] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1062.742597] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.742764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.742855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.743457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.743665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.743797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.743946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.744149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.744286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.744731] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.781150] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.141318] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.141318] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.141318] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.141318] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.141318] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.141318] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.141981] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.142433] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.142786] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.143522] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.143522] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.143733] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.146023] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.146023] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.146023] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.146023] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.166773] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.166773] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1063.166773] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.166773] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.166773] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.166773] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.166773] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.167337] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.167647] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3fe8f8d-7269-4f43-8e3a-1e73426a7503',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.247341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.247709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.247709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.248223] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.248360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.248596] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.248741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.248850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.249017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.249111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.249449] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1063.276213] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.276213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.276213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.276670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.276914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.283630] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.288492] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1063.543058] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1063.543360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.670687] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.670841] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.670968] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.671361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.671559] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.671710] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port f3fe8f8d-7269-4f43-8e3a-1e73426a7503 not found, creating... [ 1063.671987] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.672450] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.672450] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.672564] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.672693] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.673160] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.673290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.673684] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.673761] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.673963] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.674122] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: f3fe8f8d-7269-4f43-8e3a-1e73426a7503 is going to be created. [ 1063.699520] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.699719] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.699904] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.700294] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.700596] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.700885] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.786113] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.786606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.786606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.789846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.789846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.789846] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be updated. [ 1063.849080] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.849080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.849080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.849080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.849080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.860139] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: IN_PROGRESS for 2s [ 1063.971625] env[65107]: INFO networking_nsxv3.common.synchronization [None req-a8c9aec6-a3c4-4f94-9fca-b89e27019fd1 None None] Enqueued Resource ID: 056a978b-7531-4d15-a739-5a1db2a300de with Priority: HIGHEST for action port [ 1063.972717] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 056a978b-7531-4d15-a739-5a1db2a300de with Priority: HIGHEST for action port [ 1063.973177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-056a978b-7531-4d15-a739-5a1db2a300de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.973382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-056a978b-7531-4d15-a739-5a1db2a300de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.973523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-056a978b-7531-4d15-a739-5a1db2a300de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.973858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-056a978b-7531-4d15-a739-5a1db2a300de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.974276] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('056a978b-7531-4d15-a739-5a1db2a300de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.478315] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 056a978b-7531-4d15-a739-5a1db2a300de [ 1064.478402] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.478520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.478606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.478905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.479059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.479166] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:056a978b-7531-4d15-a739-5a1db2a300de already deleted. [ 1064.479340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-056a978b-7531-4d15-a739-5a1db2a300de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.528276] env[65107]: INFO networking_nsxv3.common.synchronization [req-9ee6a99b-8eb0-4212-a2c4-c281ec13ae58 req-74431cd3-6bc6-462e-a971-dd775e223ccb service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 1064.528276] env[65107]: INFO networking_nsxv3.common.synchronization [req-9ee6a99b-8eb0-4212-a2c4-c281ec13ae58 req-74431cd3-6bc6-462e-a971-dd775e223ccb service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1064.528276] env[65107]: INFO networking_nsxv3.common.synchronization [req-9ee6a99b-8eb0-4212-a2c4-c281ec13ae58 req-74431cd3-6bc6-462e-a971-dd775e223ccb service nova] Enqueued Resource ID: f3fe8f8d-7269-4f43-8e3a-1e73426a7503 with Priority: HIGHEST for action port [ 1064.529099] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 1064.529099] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1064.532693] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3fe8f8d-7269-4f43-8e3a-1e73426a7503 with Priority: HIGHEST for action port [ 1064.532693] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.532693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.532693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.532693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.532693] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.535208] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.535511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.536507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.536507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.536507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.536695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.536695] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3fe8f8d-7269-4f43-8e3a-1e73426a7503',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.042865] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.043301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.043419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3fe8f8d-7269-4f43-8e3a-1e73426a7503 with status ACTIVE [ 1065.043808] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.043808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.044056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.044325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.044443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.045284] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.045431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.045538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.045846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.045905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.046081] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.046577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.046751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.047036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.047165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.047306] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3fe8f8d-7269-4f43-8e3a-1e73426a7503 is going to be updated. [ 1065.072682] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.073054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.073054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.073394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.073622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.073914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3fe8f8d-7269-4f43-8e3a-1e73426a7503" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.300600] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1065.300790] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d deletion is rescheduled due to dependency. [ 1065.300916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.301109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.301371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.301598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.301721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.301976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.301976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.302152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.302199] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.806271] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.872573] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: SUCCESS [ 1065.872857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.873085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.873327] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.873543] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.873665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.873905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.873986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.874063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.874159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.874355] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.310450] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.378501] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.540567] env[65107]: INFO networking_nsxv3.common.synchronization [None req-0e71b24b-3a43-4506-adb9-1951f88ff84a None None] Enqueued Resource ID: 56e8ee37-21e4-48a0-becd-68ae6f101201 with Priority: HIGHEST for action port [ 1066.541258] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56e8ee37-21e4-48a0-becd-68ae6f101201 with Priority: HIGHEST for action port [ 1066.541777] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-56e8ee37-21e4-48a0-becd-68ae6f101201 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.542408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56e8ee37-21e4-48a0-becd-68ae6f101201" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.542408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56e8ee37-21e4-48a0-becd-68ae6f101201" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.542536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56e8ee37-21e4-48a0-becd-68ae6f101201" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.542714] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e8ee37-21e4-48a0-becd-68ae6f101201',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.814074] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.814344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.814435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.814754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.814882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.815026] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1066.846017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.846295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.846295] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.846458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.846605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.856292] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1066.883256] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14ef83a8-ad90-4c5e-987a-1f28536fa472: rpc.has_security_group_logging(os_id): False [ 1066.907035] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.907246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.907246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.908095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.908095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.908095] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.908095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.908399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.908399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.908477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.908592] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be updated. [ 1066.989618] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.989811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.989884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.990132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.990301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.007369] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: IN_PROGRESS for 2s [ 1067.046388] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56e8ee37-21e4-48a0-becd-68ae6f101201 [ 1067.047139] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.047582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.047825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.048339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.048635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.048923] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56e8ee37-21e4-48a0-becd-68ae6f101201 already deleted. [ 1067.049230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56e8ee37-21e4-48a0-becd-68ae6f101201" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.749043] env[65107]: INFO networking_nsxv3.common.synchronization [req-9ba89d59-a1f1-47cb-acfb-10260df7c3bc req-486a22f3-debe-4a75-b6bb-7c0b30f6c904 tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 1067.750198] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 1067.750198] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.750714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.750714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.750714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.750918] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.750918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.750918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.751122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.751184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.751275] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.254118] env[65107]: INFO networking_nsxv3.common.synchronization [None req-c32db725-1c10-4337-acc4-4a58447d76a1 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1068.254536] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.256666] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1068.257725] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.257864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.257932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.258764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.258764] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.258764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.258764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.258764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.259084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.259129] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.647588] env[65107]: INFO networking_nsxv3.common.synchronization [req-991f9518-f9f9-498f-89c8-935c76422232 req-51ede918-d0d3-4785-8592-e5dbe5ab16d8 tempest-ImagesOneServerNegativeTestJSON-1093145215 tempest-ImagesOneServerNegativeTestJSON-1093145215-project-member] Enqueued Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1068.648514] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 with Priority: HIGHEST for action security_group_members [ 1068.648882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-24eb74d4-e639-4e5a-b7df-49fe504362b3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.649055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.649155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.649729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.649729] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.649729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.649729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.650233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.650360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.650491] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24eb74d4-e639-4e5a-b7df-49fe504362b3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.758188] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.761972] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.762207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.762296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.762529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.762625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.762842] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.762936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.763011] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.763189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.763272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.763660] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1068.796597] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.798537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.798537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.798537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.798537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.813109] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1068.866544] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1068.868249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.868401] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.878557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.878557] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.878557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.878557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.878557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.878557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.878557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.878557] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.025931] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: SUCCESS [ 1069.026195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.153181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.153181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.153181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.153181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.155230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.155230] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.155230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.155230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.155230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.155230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.155230] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 is going to be updated. [ 1069.190720] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.190908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.190908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.192355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.192355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.206932] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: IN_PROGRESS for 2s [ 1069.264032] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.264475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.264657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.265103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.266503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.266697] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be updated. [ 1069.307158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.307158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.307158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.307158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.307562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.330250] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 1069.378847] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.881203] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11705357-9323-4e1c-bf51-81c8b975ee5d: rpc.has_security_group_logging(os_id): False [ 1069.900198] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.900482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.900482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.900737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.900836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.901153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.901292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.901360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.901561] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.901653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.901759] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1069.988640] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.988885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.988885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.989096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.989251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.011199] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1070.082433] env[65107]: INFO networking_nsxv3.common.synchronization [req-f1ac777d-5ec0-4448-8db5-397aff495e8c req-c6d88616-5fe2-4ffc-b502-97b3448a2cf3 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1070.083595] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1070.084227] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.084419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.084488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.084768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.085245] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.085435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.085518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.085741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.086017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.086087] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.417484] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.418062] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.418760] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.418760] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.419712] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.419712] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.419712] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.419712] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.419712] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.420075] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.420115] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.420249] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.420362] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.420544] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.420685] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.420845] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.440669] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.440843] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.440982] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.441178] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.441480] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.441651] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.441841] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.442281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.442428] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c12fc2ac-57d7-48ac-ba77-4afe328ea9f5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.588587] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.588587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.588940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.588940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.588940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.589244] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.589424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.589480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.589665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.589739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.589864] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 already deleted. [ 1070.589970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.824422] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1070.824492] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed deletion is rescheduled due to dependency. [ 1070.824625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.946207] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.946515] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.946556] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.946840] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.946992] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.947168] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 not found, creating... [ 1070.947425] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.947581] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.947695] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.947912] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.948058] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.948332] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.948483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.948595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.948791] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.950027] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.950267] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 is going to be created. [ 1070.973588] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.973779] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.973897] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.974239] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.974469] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.974690] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.219763] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 in Status: SUCCESS [ 1071.219960] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24eb74d4-e639-4e5a-b7df-49fe504362b3 deletion is rescheduled due to dependency. [ 1071.220107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24eb74d4-e639-4e5a-b7df-49fe504362b3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.347433] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 1071.347741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.723025] env[65107]: INFO networking_nsxv3.common.synchronization [req-f1ac777d-5ec0-4448-8db5-397aff495e8c req-1fb42905-cd7f-4f98-9b2a-98b566954e2c service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1071.723025] env[65107]: INFO networking_nsxv3.common.synchronization [req-f1ac777d-5ec0-4448-8db5-397aff495e8c req-1fb42905-cd7f-4f98-9b2a-98b566954e2c service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1071.723025] env[65107]: INFO networking_nsxv3.common.synchronization [req-f1ac777d-5ec0-4448-8db5-397aff495e8c req-1fb42905-cd7f-4f98-9b2a-98b566954e2c service nova] Enqueued Resource ID: c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 with Priority: HIGHEST for action port [ 1071.723025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1071.723025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1071.723025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 with Priority: HIGHEST for action port [ 1071.723025] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.727036] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.727036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.727036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.727036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.727036] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.729504] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.729863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.730054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.730339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.730949] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c12fc2ac-57d7-48ac-ba77-4afe328ea9f5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.025357] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1072.025872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.233894] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.234834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.234834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.234834] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 with status ACTIVE [ 1072.234834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.234834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.234834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.235694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.235694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.235694] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.235694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.235694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.235694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.235694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.236111] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.236111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.236111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.236111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.236342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.236342] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c12fc2ac-57d7-48ac-ba77-4afe328ea9f5 is going to be updated. [ 1072.260072] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.260262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.260347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.260537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.260671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.260838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c12fc2ac-57d7-48ac-ba77-4afe328ea9f5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.739298] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.243789] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.244125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.244213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.244485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.244633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.244771] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be created. [ 1073.276159] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.276420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.276546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.276754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.277030] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.288761] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: UNINITIALIZED for 2s [ 1074.727182] env[65107]: INFO networking_nsxv3.common.synchronization [req-f49086c4-be51-412d-86a5-cafcfedc1381 req-2d8b7d68-58ec-46b7-8082-cb2615894ae3 tempest-ServerRescueNegativeTestJSON-805558539 tempest-ServerRescueNegativeTestJSON-805558539-project-member] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 1074.727870] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGHEST for action security_group_members [ 1074.728880] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.729095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.730154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.730424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.730576] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.730688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.730998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.731213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.731328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.731426] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.236041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.236278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.236350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.236553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.236648] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.236898] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.237020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.237073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.237245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.237332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.237425] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be updated. [ 1075.266297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.266545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.266650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.266873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.267026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.277886] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: IN_PROGRESS for 2s [ 1075.303846] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1075.304169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.304362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.304590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.304773] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.304888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.304956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.305128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.305212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.309025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.309025] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.809165] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.809540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.809540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.809765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.809977] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.810123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.810195] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.810402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.810508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.810607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.810766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.810863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.810925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.811092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.811241] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.811337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.811400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.811544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.811626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.811712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.811806] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.315497] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cacf6191-ed0d-498d-a524-904b8f81b797: rpc.has_security_group_logging(os_id): False [ 1076.346880] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.346880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.347208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.347208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.347287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.347470] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.347563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.347700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.347761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.347871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.348041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.348141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.348200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.348335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.349549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.349549] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.349549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.349549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.349549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.349549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.349549] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be created. [ 1076.435088] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.435088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.435285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.435377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.435546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.448763] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1077.290488] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f in Status: SUCCESS [ 1077.290846] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f deletion is rescheduled due to dependency. [ 1077.290846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.438031] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.438031] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.438252] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.438329] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.438584] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.438738] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.438852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.439073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.439231] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.439495] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.439613] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.439718] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.439816] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.439921] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.440040] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.440172] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.459261] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.459384] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.459442] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.459613] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.459935] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-919956ea-4c6e-4064-b420-68294a0f9d1b taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.460124] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.460256] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.460539] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.460683] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919956ea-4c6e-4064-b420-68294a0f9d1b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.963320] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.963581] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.963705] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.964099] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.964248] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.964662] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.964829] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.964948] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.965744] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.965744] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.965744] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.965941] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.966272] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.966272] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.966604] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.966604] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 919956ea-4c6e-4064-b420-68294a0f9d1b is going to be updated. [ 1077.993045] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.993313] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.993430] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.993693] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.993894] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.994281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.462172] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1078.462570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.801617] env[65107]: INFO networking_nsxv3.common.synchronization [req-a2f9ba08-1af4-4b70-a4ed-e722cff7d612 req-d9ed1f46-cea2-4e48-94d1-eeb257c365eb service nova] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 1078.801800] env[65107]: INFO networking_nsxv3.common.synchronization [req-a2f9ba08-1af4-4b70-a4ed-e722cff7d612 req-d9ed1f46-cea2-4e48-94d1-eeb257c365eb service nova] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 1078.801937] env[65107]: INFO networking_nsxv3.common.synchronization [req-a2f9ba08-1af4-4b70-a4ed-e722cff7d612 req-d9ed1f46-cea2-4e48-94d1-eeb257c365eb service nova] Enqueued Resource ID: 919956ea-4c6e-4064-b420-68294a0f9d1b with Priority: HIGHEST for action port [ 1078.802501] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_rules [ 1078.802644] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 1078.802741] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 919956ea-4c6e-4064-b420-68294a0f9d1b with Priority: HIGHEST for action port [ 1078.809117] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.809258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.809322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.809527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.809610] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.813700] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.813700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.813700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.814542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.814542] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.814641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.814678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.814852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.815071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.815071] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.815870] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-919956ea-4c6e-4064-b420-68294a0f9d1b taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.815975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.816411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.816411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.816556] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919956ea-4c6e-4064-b420-68294a0f9d1b',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.043210] env[65107]: INFO networking_nsxv3.common.synchronization [None req-8e8d9b06-8383-42b8-9535-d375b5d3fa95 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_rules [ 1079.043768] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_rules [ 1079.044654] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.044795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.044880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.045239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.045349] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.140796] env[65107]: INFO networking_nsxv3.common.synchronization [None req-9798ae82-a525-419e-98ab-202f348f1dc1 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_rules [ 1079.141447] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_rules [ 1079.141762] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.141891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.318854] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 919956ea-4c6e-4064-b420-68294a0f9d1b with status ACTIVE [ 1079.319193] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.319513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.319598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.319792] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.319888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.320099] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.320202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.320283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.320448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.320530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.320714] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.320807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.320868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.321013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.321093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.321176] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 919956ea-4c6e-4064-b420-68294a0f9d1b is going to be updated. [ 1079.322412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.322536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.322749] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.350933] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.351168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.351168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.351410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.351562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.351740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-919956ea-4c6e-4064-b420-68294a0f9d1b" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.569636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.569636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.569636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.570287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.570287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.570287] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 already deleted. [ 1079.570424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.570617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.570818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.570928] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.825968] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.094966] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.095134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.095207] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.095430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.095518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.095617] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 already deleted. [ 1080.095767] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.328305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.328494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.328575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.328744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.328835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.328967] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e is going to be updated. [ 1080.366053] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.366053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.366053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.366377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.366377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.376340] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: IN_PROGRESS for 2s [ 1080.919352] env[65107]: INFO networking_nsxv3.common.synchronization [req-c473c4e2-1900-4be5-84b8-fc994d3c5b33 req-093ef222-28b9-4e90-8514-2783d459dd9d tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1080.919929] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1080.920189] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.920313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.920387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.920666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.921565] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.921744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.921860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.922108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.922206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.922279] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.426092] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.426367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.426461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.426667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.426770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.427050] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.427194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.427259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.427478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.427478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.427751] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1081.475599] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.475837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.475837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.476031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.476174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.485909] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1082.155433] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.155787] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.155787] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.155991] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.156262] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.156420] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.156531] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.156742] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.156881] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.157565] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.157700] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.157809] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.157916] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.158043] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.158149] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.158277] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.178909] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.179170] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.179347] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.179532] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.179935] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.180137] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.180354] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.181530] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.181530] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c53b3c-7f70-46c3-94b1-098bb7508a8e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.386407] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: SUCCESS [ 1082.386644] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.386814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.387058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.387296] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.387405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.387457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.387588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.387658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.387750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.387840] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.684317] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.684317] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.684317] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.684317] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.684827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.684827] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port c1c53b3c-7f70-46c3-94b1-098bb7508a8e not found, creating... [ 1082.685217] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.685217] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.685428] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.685667] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.685752] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.686026] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.686214] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.686335] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.686723] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.686902] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.687095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e is going to be created. [ 1082.712388] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.712388] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.712388] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.712388] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.712388] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.712886] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.890768] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.391953] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb36a1e8-ba8d-491f-8291-18b58f2dfd6e: rpc.has_security_group_logging(os_id): False [ 1083.411100] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.411747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.411907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.412202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.412260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.412487] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.412593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.412658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.412811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.412888] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.412976] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e is going to be updated. [ 1083.420890] env[65107]: INFO networking_nsxv3.common.synchronization [req-87f57633-24a5-4a2a-83d1-7dffcadcc3c3 req-e87596ca-5709-4132-b273-93b6eadc9ffc service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 1083.421101] env[65107]: INFO networking_nsxv3.common.synchronization [req-87f57633-24a5-4a2a-83d1-7dffcadcc3c3 req-e87596ca-5709-4132-b273-93b6eadc9ffc service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1083.421246] env[65107]: INFO networking_nsxv3.common.synchronization [req-87f57633-24a5-4a2a-83d1-7dffcadcc3c3 req-e87596ca-5709-4132-b273-93b6eadc9ffc service nova] Enqueued Resource ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e with Priority: HIGHEST for action port [ 1083.421478] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 1083.421610] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1083.421707] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e with Priority: HIGHEST for action port [ 1083.422671] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.422743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.422782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.422937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.423066] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.423923] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.424302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.424366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.424537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.424688] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.424784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.424837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.425208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.425339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.425481] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.426809] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.427014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.427156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.427250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.427326] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c53b3c-7f70-46c3-94b1-098bb7508a8e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.477772] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.479490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.480632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.480856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.481250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.497451] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: IN_PROGRESS for 2s [ 1083.502547] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1083.502740] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1083.502860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.930317] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.930501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.930876] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.931829] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1c53b3c-7f70-46c3-94b1-098bb7508a8e with status ACTIVE [ 1083.932117] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.932252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.932319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.932525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.932615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.932791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.932887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.932946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.933455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.933575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.933778] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.933873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.933931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.934464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.934559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.934652] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e is going to be updated. [ 1083.956317] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.956448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.956652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.956973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.957133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.957297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.437559] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.940438] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.940671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.940754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.941022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.941153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.941282] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1084.976328] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.976616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.976746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.977059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.977280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.986627] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1085.516262] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: SUCCESS [ 1085.516262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.270495] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4db7cbca-95c5-4a56-8354-9037afe5a419 None None] Enqueued Resource ID: 9edeec0d-5b33-4ec9-92eb-3c316be0a67d with Priority: HIGHEST for action port [ 1086.270495] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9edeec0d-5b33-4ec9-92eb-3c316be0a67d with Priority: HIGHEST for action port [ 1086.270495] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-9edeec0d-5b33-4ec9-92eb-3c316be0a67d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.270495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9edeec0d-5b33-4ec9-92eb-3c316be0a67d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.270495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9edeec0d-5b33-4ec9-92eb-3c316be0a67d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.271271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9edeec0d-5b33-4ec9-92eb-3c316be0a67d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.271380] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9edeec0d-5b33-4ec9-92eb-3c316be0a67d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.626866] env[65107]: INFO networking_nsxv3.common.synchronization [None req-41d4be90-9496-4a08-9e49-e9b9ead7c45a tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_rules [ 1086.627377] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_rules [ 1086.627657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eddc4b52-aa90-46fd-ba26-8d960baeb169 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.627785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.627851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.628348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.628471] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.728509] env[65107]: INFO networking_nsxv3.common.synchronization [None req-abcf844f-4fb6-41ce-908f-c1f42cc29638 tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_rules [ 1086.729325] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_rules [ 1086.729807] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eddc4b52-aa90-46fd-ba26-8d960baeb169 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.729938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.774098] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9edeec0d-5b33-4ec9-92eb-3c316be0a67d [ 1086.774259] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.774423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.774477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.774686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.774785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.774887] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9edeec0d-5b33-4ec9-92eb-3c316be0a67d already deleted. [ 1086.774969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9edeec0d-5b33-4ec9-92eb-3c316be0a67d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.999874] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1087.000133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.000343] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.000563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.000763] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.001098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.001098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.001190] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.001224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.001351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.001422] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.154928] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.155094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.155158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.155398] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.155484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.155575] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 already deleted. [ 1087.155654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.155810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.155959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.157195] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.505743] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.505989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.505989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.506206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.506399] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.506506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.506572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.506722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.506816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.506903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.507063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.507161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.507241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.507392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.507533] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.507622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.507681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.507816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.507892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.507994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.508071] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.680831] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.680831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.680831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.681317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.681317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.681424] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 already deleted. [ 1087.681474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.010144] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 814a62b8-5b9a-4a8b-96c6-18956744a0ed: rpc.has_security_group_logging(os_id): False [ 1088.032367] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.032573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.032625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.032832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.032930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.033161] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.033276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.033387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.033511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.033575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.033785] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.033880] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.033940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.034132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.034243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.034444] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.034604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.034604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.034799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.034799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.034886] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1088.123555] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.123855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.123855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.124069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.124369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.159565] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1088.810632] env[65107]: INFO networking_nsxv3.common.synchronization [None req-69071d7b-7a10-44ee-91f9-1096c464d18e None None] Enqueued Resource ID: 03fa6700-3fe5-423d-8918-8d74c3f22d44 with Priority: HIGHEST for action port [ 1088.810632] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fa6700-3fe5-423d-8918-8d74c3f22d44 with Priority: HIGHEST for action port [ 1088.810632] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-03fa6700-3fe5-423d-8918-8d74c3f22d44 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.811157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03fa6700-3fe5-423d-8918-8d74c3f22d44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.811345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03fa6700-3fe5-423d-8918-8d74c3f22d44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.811727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03fa6700-3fe5-423d-8918-8d74c3f22d44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.811997] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03fa6700-3fe5-423d-8918-8d74c3f22d44',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.187595] env[65107]: INFO networking_nsxv3.common.synchronization [req-8cc3b9fd-965c-4c28-b6cd-6330fc2ca6b7 req-5c7496bd-4b1e-4e63-a590-6c576da32b52 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_members [ 1089.188644] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_members [ 1089.188644] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.188827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.188827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.189526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.189526] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.189526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.189764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.189764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.189863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.189914] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.314853] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03fa6700-3fe5-423d-8918-8d74c3f22d44 [ 1089.315487] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.315796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.315969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.316379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.316609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.316807] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03fa6700-3fe5-423d-8918-8d74c3f22d44 already deleted. [ 1089.316990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03fa6700-3fe5-423d-8918-8d74c3f22d44" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.582983] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.583260] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.583427] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.584613] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.584613] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.584613] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.584613] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.584989] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.584989] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.585254] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.585254] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.585379] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.585490] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.585623] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.585722] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.585856] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.605831] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.606090] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.606240] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.606489] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.606823] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.606996] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.607131] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.607455] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.607590] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8feb3fe8-b1da-4bd4-8011-92abfbc734b4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.691954] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.692150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.692150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.692835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.692835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.692835] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.692835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.692835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.693128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.693169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.693231] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 already deleted. [ 1089.693308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.109643] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.109956] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.110024] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.110312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.110482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.110635] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 8feb3fe8-b1da-4bd4-8011-92abfbc734b4 not found, creating... [ 1090.110895] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.111062] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.111179] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.111401] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.111534] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.111808] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.111961] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.112111] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.112362] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.112496] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.112634] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 8feb3fe8-b1da-4bd4-8011-92abfbc734b4 is going to be created. [ 1090.133095] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.133334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.133443] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.134077] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.134077] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.134288] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.179352] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1090.179352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.884713] env[65107]: INFO networking_nsxv3.common.synchronization [req-8cc3b9fd-965c-4c28-b6cd-6330fc2ca6b7 req-72bedff4-ee3f-4343-aef3-5a4ffb7a5ed9 service nova] Enqueued Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_rules [ 1090.884813] env[65107]: INFO networking_nsxv3.common.synchronization [req-8cc3b9fd-965c-4c28-b6cd-6330fc2ca6b7 req-72bedff4-ee3f-4343-aef3-5a4ffb7a5ed9 service nova] Enqueued Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_members [ 1090.884966] env[65107]: INFO networking_nsxv3.common.synchronization [req-8cc3b9fd-965c-4c28-b6cd-6330fc2ca6b7 req-72bedff4-ee3f-4343-aef3-5a4ffb7a5ed9 service nova] Enqueued Resource ID: 8feb3fe8-b1da-4bd4-8011-92abfbc734b4 with Priority: HIGHEST for action port [ 1090.885789] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_rules [ 1090.885789] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_members [ 1090.886029] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb3fe8-b1da-4bd4-8011-92abfbc734b4 with Priority: HIGHEST for action port [ 1090.886252] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.886317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.886421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.887041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.887041] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.888179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.888305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.888362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.889465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.889610] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.889731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.889780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.889927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.890024] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.890122] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.891274] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.891389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.891467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.891604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.891683] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8feb3fe8-b1da-4bd4-8011-92abfbc734b4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.393727] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.394157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.394307] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.396047] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8feb3fe8-b1da-4bd4-8011-92abfbc734b4 with status ACTIVE [ 1091.396047] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.396047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.396047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.396392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.396392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.396392] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.396486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.396636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.396703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.396800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.397788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.397788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.397788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.397788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.397788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.397788] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8feb3fe8-b1da-4bd4-8011-92abfbc734b4 is going to be updated. [ 1091.420562] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.420729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.420782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.421021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.421167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.421341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8feb3fe8-b1da-4bd4-8011-92abfbc734b4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.899546] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.403012] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.403433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.403433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.403516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.403625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.403740] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 is going to be created. [ 1092.432581] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.432581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.432581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.432581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.432581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.442578] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 in Status: UNINITIALIZED for 2s [ 1092.844615] env[65107]: INFO networking_nsxv3.common.synchronization [req-126ff3cb-3136-4617-a878-8d47ee34b202 req-e5a09166-30ab-4fbb-8540-950039662540 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1092.845444] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1092.845571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.845628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.845691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.845894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.846065] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.846170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.846232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.846386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.846563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.846563] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.176847] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.177104] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.177275] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.177578] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.177881] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.178084] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.178236] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.178484] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.178677] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.179035] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.179213] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.179365] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.179488] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.179769] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.179769] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.179937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.198714] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.198882] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1093.199039] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.199286] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.199639] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.199835] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.199953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.200343] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.200525] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.348242] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.703266] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.704290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.704290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.704496] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.704742] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.704902] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 not found, creating... [ 1093.705202] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.705381] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.705508] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.705803] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.705985] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.706321] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.706478] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.706593] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.706808] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.706940] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.707098] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 is going to be created. [ 1093.727474] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.727695] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.727815] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.728098] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.728359] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.728588] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.850371] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.355526] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.355526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.355526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.355526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.355526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.355526] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1094.390049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.390160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.390197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.390457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.390613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.401942] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1094.447387] env[65107]: INFO networking_nsxv3.common.synchronization [req-126ff3cb-3136-4617-a878-8d47ee34b202 req-5ade806e-58bb-431e-b889-22244c4e0aa7 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1094.447859] env[65107]: INFO networking_nsxv3.common.synchronization [req-126ff3cb-3136-4617-a878-8d47ee34b202 req-5ade806e-58bb-431e-b889-22244c4e0aa7 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1094.448145] env[65107]: INFO networking_nsxv3.common.synchronization [req-126ff3cb-3136-4617-a878-8d47ee34b202 req-5ade806e-58bb-431e-b889-22244c4e0aa7 service nova] Enqueued Resource ID: 47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 with Priority: HIGHEST for action port [ 1094.448905] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1094.450437] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1094.450437] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 with Priority: HIGHEST for action port [ 1094.450437] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.450437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.450437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.450437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.450437] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.450965] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.451075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.451272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.453020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.453102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.453318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.453458] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.455808] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 in Status: SUCCESS [ 1094.456547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.456547] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.456656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.456800] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.456889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.456949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.457245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.457245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.457306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.457705] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.955805] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.956138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.959424] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 with status ACTIVE [ 1094.959708] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.959895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.959975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.960603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.960712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.960921] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.961073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.961380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.961608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.961726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.961989] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.962102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.962143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.962302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.962379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.962465] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4 is going to be updated. [ 1094.963680] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.987217] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.987382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.987530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.987663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.987828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.987953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47c0c7fc-e008-4f88-98f2-bb7cb80ff8f4" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.270759] env[65107]: INFO networking_nsxv3.common.synchronization [req-af94a180-8899-4ab1-b08e-b9c8d8d30be3 req-9900c2cf-d9af-4e28-a287-e85b289634ef tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_members [ 1095.271435] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_members [ 1095.271799] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-eddc4b52-aa90-46fd-ba26-8d960baeb169 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.272021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.272091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.272370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.272571] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.272699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.272788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.273048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.273105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.273902] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.468549] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b4c1c41-3e51-4f2c-b0f0-da054bcade26: rpc.has_security_group_logging(os_id): False [ 1095.488422] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.488633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.488744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.489063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.489215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.489559] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.489713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.489810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.490046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.490168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.490293] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 is going to be created. [ 1095.555551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.555734] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.555837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.556142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.556380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.572939] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 in Status: IN_PROGRESS for 2s [ 1095.688093] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.688093] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.688093] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.688093] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.688093] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.688369] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.688944] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.688944] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.688944] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.689081] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.689183] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.689532] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.689532] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.689532] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.689646] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.689850] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.707854] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.708050] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.708171] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.708355] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.708665] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.708832] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.708950] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.709303] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.709443] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.775758] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.775891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.775972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.776309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.776481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.776787] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.776935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.777015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.777185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.777267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.777376] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 already deleted. [ 1095.777430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.213668] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.214133] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.214133] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.215028] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.215028] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.215028] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c not found, creating... [ 1096.215028] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.215213] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.215213] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.215411] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.215561] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.215931] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.216104] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.216222] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.216446] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.216601] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.216739] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c is going to be created. [ 1096.238253] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.238439] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.238439] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.238756] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.239039] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.239302] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.413965] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1096.414301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.414490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.414723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.414939] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.415129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.415258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.415491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.415599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.415741] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.918734] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.974244] env[65107]: INFO networking_nsxv3.common.synchronization [req-af94a180-8899-4ab1-b08e-b9c8d8d30be3 req-b4689c3c-49e7-4ee1-ab75-6852d9e2436b service nova] Enqueued Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_rules [ 1096.974434] env[65107]: INFO networking_nsxv3.common.synchronization [req-af94a180-8899-4ab1-b08e-b9c8d8d30be3 req-b4689c3c-49e7-4ee1-ab75-6852d9e2436b service nova] Enqueued Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_members [ 1096.974876] env[65107]: INFO networking_nsxv3.common.synchronization [req-af94a180-8899-4ab1-b08e-b9c8d8d30be3 req-b4689c3c-49e7-4ee1-ab75-6852d9e2436b service nova] Enqueued Resource ID: e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c with Priority: HIGHEST for action port [ 1096.975125] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_rules [ 1096.975274] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_members [ 1096.975378] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c with Priority: HIGHEST for action port [ 1096.975673] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eddc4b52-aa90-46fd-ba26-8d960baeb169 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.976182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.976319] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.976607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.976740] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.978077] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-eddc4b52-aa90-46fd-ba26-8d960baeb169 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.978262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.978381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.978603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.978909] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.979056] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.979168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.979368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.979506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.979642] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.981324] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.981628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.981628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.981803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.981916] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.422136] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.486316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-eddc4b52-aa90-46fd-ba26-8d960baeb169 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.486316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.486316] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.486640] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c with status ACTIVE [ 1097.487482] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.487482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.487482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.487482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.487482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.487482] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.487722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.488411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.489379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.489379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.489379] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.489379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.489379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.489379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.489573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.489573] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c is going to be updated. [ 1097.511729] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.511929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.511929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.512165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.512314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.512491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9a83d0d-acf0-40a5-8a87-9ba01f1bd77c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.642572] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 in Status: SUCCESS [ 1097.642809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.927195] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.927436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.927436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.927708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.927787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.927886] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1097.964285] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.964545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.964545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.964721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.964866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.975458] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1097.993280] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.496337] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.496628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.496628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.496786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.498061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.498061] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 is going to be created. [ 1098.530460] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.531220] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.531626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.532149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.532503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.545817] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 in Status: UNINITIALIZED for 2s [ 1098.743604] env[65107]: INFO networking_nsxv3.common.synchronization [req-0de16b53-c089-4253-ac0b-9a335f7c4a4a req-445b0817-4448-4cbd-817d-b9aed14b2243 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1098.743604] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1098.743604] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.743604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.743807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.744568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.744568] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.744568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.744568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.744739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.744739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.744843] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.163481] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.163730] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.163774] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.164223] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.164392] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.164556] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.164671] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.164991] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.165093] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.165247] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.165463] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.165463] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.165633] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.165633] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.165740] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.165901] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.190100] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.190339] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.190482] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.190608] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.190957] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-789b8431-3161-4d79-8f1a-d9ee3cae500f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.191167] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.191266] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.191616] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.191768] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('789b8431-3161-4d79-8f1a-d9ee3cae500f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.247794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.247794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.247794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.248142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.248269] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.248578] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.248740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.248842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.249257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.249257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.249339] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1099.287511] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.287796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.287796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.288054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.288266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.299068] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1099.481740] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.481937] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.482128] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.482579] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.482671] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.482837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.482955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.483421] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.483568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.483785] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.483897] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.484027] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.484171] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.484314] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.484427] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.484558] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.504283] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.504581] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.504639] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.504770] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-146" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.505116] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.505311] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.505433] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.505704] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.505861] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c53b3c-7f70-46c3-94b1-098bb7508a8e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.695364] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.695663] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.695800] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.696111] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.696270] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.696502] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 789b8431-3161-4d79-8f1a-d9ee3cae500f not found, creating... [ 1099.696801] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.696958] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.697085] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.697318] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.697452] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.697731] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.697883] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.697996] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.698232] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.698346] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.698483] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 789b8431-3161-4d79-8f1a-d9ee3cae500f is going to be created. [ 1099.719067] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.719281] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.719404] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.719682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.719909] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.720150] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.985740] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1099.986021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.986226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.986477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.986706] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.986854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.986929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.987142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.987247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.987351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.987475] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.008871] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.009252] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.009252] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.009501] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.009649] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.009938] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.010101] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.010206] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.010414] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.010595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.010818] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.010986] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.011083] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.011301] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.011437] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.011604] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e is going to be updated. [ 1100.035014] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.035262] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.035312] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.035690] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.035891] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.036131] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.439139] env[65107]: INFO networking_nsxv3.common.synchronization [req-0de16b53-c089-4253-ac0b-9a335f7c4a4a req-38ab6a0d-54b6-4ce7-bb29-9a638d91e1f8 service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1100.439327] env[65107]: INFO networking_nsxv3.common.synchronization [req-0de16b53-c089-4253-ac0b-9a335f7c4a4a req-38ab6a0d-54b6-4ce7-bb29-9a638d91e1f8 service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1100.439463] env[65107]: INFO networking_nsxv3.common.synchronization [req-0de16b53-c089-4253-ac0b-9a335f7c4a4a req-38ab6a0d-54b6-4ce7-bb29-9a638d91e1f8 service nova] Enqueued Resource ID: 789b8431-3161-4d79-8f1a-d9ee3cae500f with Priority: HIGHEST for action port [ 1100.439989] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1100.440109] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1100.440218] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789b8431-3161-4d79-8f1a-d9ee3cae500f with Priority: HIGHEST for action port [ 1100.440473] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.440595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.440650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.440848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.440931] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.442611] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.442742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.442940] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-789b8431-3161-4d79-8f1a-d9ee3cae500f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.443105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.443201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.443382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.443485] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('789b8431-3161-4d79-8f1a-d9ee3cae500f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.489575] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.490739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.490832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.491103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.491315] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.491432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.491498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.491676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.491769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.491896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.492116] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.492253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.492298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.492452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.492603] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.492697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.492761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.492905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.492998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.493102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.493200] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.555865] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 in Status: SUCCESS [ 1100.556135] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.556278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.556652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.556855] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.557061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.557061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.557206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.558701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.559754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.559754] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.756615] env[65107]: INFO networking_nsxv3.common.synchronization [req-3f1487c1-5c67-4648-b45e-4dcc930db3bb req-73fa154a-1358-46f8-bb55-a12dfa2e765d service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 1100.756761] env[65107]: INFO networking_nsxv3.common.synchronization [req-3f1487c1-5c67-4648-b45e-4dcc930db3bb req-73fa154a-1358-46f8-bb55-a12dfa2e765d service nova] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1100.756906] env[65107]: INFO networking_nsxv3.common.synchronization [req-3f1487c1-5c67-4648-b45e-4dcc930db3bb req-73fa154a-1358-46f8-bb55-a12dfa2e765d service nova] Enqueued Resource ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e with Priority: HIGHEST for action port [ 1100.757521] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_rules [ 1100.757663] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1100.757766] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e with Priority: HIGHEST for action port [ 1100.758063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.758188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.758324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.758512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.758601] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.759465] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.759582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.759650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.759812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.759958] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.760065] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.760127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.760272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.760381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.760441] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.761282] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.761391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.761457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.761609] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.761683] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c53b3c-7f70-46c3-94b1-098bb7508a8e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.944600] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.944600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.948590] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 789b8431-3161-4d79-8f1a-d9ee3cae500f with status ACTIVE [ 1100.948590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.948590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.948590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.948590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.950713] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 789b8431-3161-4d79-8f1a-d9ee3cae500f is going to be updated. [ 1100.974405] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.975407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.975407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.975407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.975407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.975590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-789b8431-3161-4d79-8f1a-d9ee3cae500f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.996981] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cacf6191-ed0d-498d-a524-904b8f81b797: rpc.has_security_group_logging(os_id): False [ 1101.015938] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.016112] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.016151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.016366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.016466] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.016662] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.016764] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.016839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.017020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.017102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.017301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.017397] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.017458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.017596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.017670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.017856] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.017948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.018017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.018156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.018230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.018322] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1101.061151] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.104793] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.105036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.105036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.105227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.105394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.118075] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1101.263543] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.263775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.263939] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.264964] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1c53b3c-7f70-46c3-94b1-098bb7508a8e with status ACTIVE [ 1101.265166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.265391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.265391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.265564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.265656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.265835] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.265934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.265981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.266493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.266493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.266493] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.266711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.266711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.266711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.266845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.266845] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1c53b3c-7f70-46c3-94b1-098bb7508a8e is going to be updated. [ 1101.301857] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.302154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.302154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.302346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.302432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.302598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c53b3c-7f70-46c3-94b1-098bb7508a8e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.312735] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1101.312920] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1101.313060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.313234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.313526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.313738] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.313861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.313944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.314108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.314225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.314328] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.564138] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eddc4b52-aa90-46fd-ba26-8d960baeb169: rpc.has_security_group_logging(os_id): False [ 1101.583997] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.584326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.584418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.584699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.584804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.585178] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.585355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.585478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.585678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.585769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.585866] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 is going to be created. [ 1101.675036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.675270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.675355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.675598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.675883] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.689656] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 in Status: IN_PROGRESS for 2s [ 1101.769452] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.816201] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.273412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.273655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.273655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.274225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.274225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.274225] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1102.307893] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.308076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.308119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.308340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.308483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.318375] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.320050] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1102.821517] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.821998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.821998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.821998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.822149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.822258] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1102.854709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.854885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.854925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.855151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.855337] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.865376] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1103.134974] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1103.135221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.715032] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 in Status: SUCCESS [ 1103.715265] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.332976] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1104.333393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.333433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.333659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.333863] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.334022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.334095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.334350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.334437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.334529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.334621] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.837083] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.837083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.837083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.837485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.837485] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.837485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.837485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.837736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.837736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.837831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.837957] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.838058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.838113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.838247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.838385] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.838636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.838719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.838867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.838932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.839029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.839118] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.874720] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1104.874923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.875150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.875345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.875540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.875657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.875719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.875871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.875953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.876053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.876145] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.342105] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 814a62b8-5b9a-4a8b-96c6-18956744a0ed: rpc.has_security_group_logging(os_id): False [ 1105.362524] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.362699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.362786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.363050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.363160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.363360] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.363458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.363519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.363680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.363758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.363954] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.364071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.364136] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.364282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.364360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.364568] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.364673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.364727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.364862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.364955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.365024] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1105.377941] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.378120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.378191] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.378403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.378567] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.378664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.378725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.378872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.378956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.379075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.379236] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.379332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.379392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.379533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.379667] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.379757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.379815] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.379947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.380046] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.380128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.380217] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.433847] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.434010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.434088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.434371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.434525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.452460] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1105.759209] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.759395] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1105.882170] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c066e724-cbaf-469e-be19-001bda52a5c7: rpc.has_security_group_logging(os_id): False [ 1105.906176] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.906405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.906654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.906940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.907113] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.907421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.907587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.907695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.907949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.908513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.908513] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.908711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.908711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.908935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.909032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.910709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.910709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.910709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.910709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.910709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.910709] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1106.023139] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.023386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.023497] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.023809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.024042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.039015] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1107.468550] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1107.468997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.056197] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1108.056440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.089538] env[65107]: INFO networking_nsxv3.common.synchronization [req-2b4fe7b0-5309-4211-b085-d69cfe1f1e9a req-e7072e01-7610-4ad4-b20b-28a8ba466962 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1109.090085] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1109.090421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.090546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.090674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.090800] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.090949] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.096026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.096026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.096026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.096026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.096026] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.596017] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.098806] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.601170] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.601344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.601419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.601637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.601735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.601869] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1110.635696] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.635849] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.635944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.636159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.636306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.646345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1112.658657] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1112.659069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.091799] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1114.092298] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1116.872202] env[65107]: INFO networking_nsxv3.common.synchronization [req-a8fa8fe6-fdc8-4b92-bd70-f9822ba6f362 req-8a43bbec-8815-44ae-b7f6-568c5ab24548 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1116.873516] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1116.873516] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.873516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.873516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.873516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.873826] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.873826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.873912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.874029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.874123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.874471] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.376936] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.879825] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.382388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.382590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.382684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.382947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.383072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.383200] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be updated. [ 1118.413207] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.413407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.413450] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.413647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.413794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.424128] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: IN_PROGRESS for 2s [ 1118.624382] env[65107]: INFO networking_nsxv3.common.synchronization [req-b8b3ff54-52f9-4693-8fa8-365486b3f313 req-ed8e9b63-d079-4303-a0df-0b997b7e304f tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1118.625196] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1118.625653] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.625816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.625942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.626701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.626701] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.626701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.626701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.626945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.627063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.627189] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.959751] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.960107] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.960107] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.960369] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.960645] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.960803] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.960919] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.961329] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.961492] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.961722] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.961836] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.961958] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.962115] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.962217] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.962328] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.962465] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.982932] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.983143] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.983260] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.983436] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.983767] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-4caddb03-bffc-49ab-9f66-43470bfe0b95 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.983951] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.984087] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.984504] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.984641] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4caddb03-bffc-49ab-9f66-43470bfe0b95',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.129416] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.488068] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.488341] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.488526] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.488892] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.489111] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.489332] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 4caddb03-bffc-49ab-9f66-43470bfe0b95 not found, creating... [ 1119.489715] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.489939] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.490148] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.490432] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.490630] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.491075] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.491290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.491498] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.491755] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.491934] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.492184] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 4caddb03-bffc-49ab-9f66-43470bfe0b95 is going to be created. [ 1119.515184] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.515489] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.515646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.516016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.516326] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.516705] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.631853] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.136036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.136405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.136405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.136507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.136575] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.136675] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1120.174051] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.174051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.174051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.174051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.174051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.183959] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1120.236435] env[65107]: INFO networking_nsxv3.common.synchronization [req-b8b3ff54-52f9-4693-8fa8-365486b3f313 req-510ab6d9-39f2-46a9-8773-b8e581f03aa9 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1120.236736] env[65107]: INFO networking_nsxv3.common.synchronization [req-b8b3ff54-52f9-4693-8fa8-365486b3f313 req-510ab6d9-39f2-46a9-8773-b8e581f03aa9 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1120.236912] env[65107]: INFO networking_nsxv3.common.synchronization [req-b8b3ff54-52f9-4693-8fa8-365486b3f313 req-510ab6d9-39f2-46a9-8773-b8e581f03aa9 service nova] Enqueued Resource ID: 4caddb03-bffc-49ab-9f66-43470bfe0b95 with Priority: HIGHEST for action port [ 1120.237836] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1120.238096] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1120.238290] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4caddb03-bffc-49ab-9f66-43470bfe0b95 with Priority: HIGHEST for action port [ 1120.238735] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.238930] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.239067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.239616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.239766] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.240778] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.240907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.241619] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-4caddb03-bffc-49ab-9f66-43470bfe0b95 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.241619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.241619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.241826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.242504] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4caddb03-bffc-49ab-9f66-43470bfe0b95',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.435849] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: SUCCESS [ 1120.436051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.743991] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.744342] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.744561] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4caddb03-bffc-49ab-9f66-43470bfe0b95 with status ACTIVE [ 1120.744775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.744896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.745041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.745204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.745362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.745574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.745657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.745693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.745844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.745920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.746126] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.746243] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.746320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.746418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.746552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.746608] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4caddb03-bffc-49ab-9f66-43470bfe0b95 is going to be updated. [ 1120.768734] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.768953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.769044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.769226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.769405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.769593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4caddb03-bffc-49ab-9f66-43470bfe0b95" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.194186] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1122.194568] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.194636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.194857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.195102] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.195217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.195279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.195453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.195532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.195632] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.698350] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.165436] env[65107]: INFO networking_nsxv3.common.synchronization [req-9c087744-54c3-4500-9fea-73e1e50d3238 req-9fff23d6-85c3-411d-a3ab-b91170d03e8a tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1123.166105] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGHEST for action security_group_members [ 1123.166474] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.166474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.166474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.166652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.166796] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.166889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.166947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.167170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.167217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.167300] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.343551] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.671073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.671240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.671310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.671522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.671983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.671983] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.671983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.671983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.672272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.672272] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.672359] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be updated. [ 1123.702765] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.702765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.702998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.703294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.703524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.712686] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: IN_PROGRESS for 2s [ 1123.845726] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.845903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.845985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.846268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.846384] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.846495] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1123.876908] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.877069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.877188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.877347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.877503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.887037] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1125.721938] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 in Status: SUCCESS [ 1125.722350] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 deletion is rescheduled due to dependency. [ 1125.722350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.896870] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1125.897096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.897274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.897488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.897686] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.897889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.897949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.898119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.898199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.898283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.898377] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.400395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.400591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.400669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.400921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.401108] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.401208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.401271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.401427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.401514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.401600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.401746] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.401836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.401895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.402040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.402196] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.402301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.402382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.402542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.402641] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.402757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.402831] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.905325] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cacf6191-ed0d-498d-a524-904b8f81b797: rpc.has_security_group_logging(os_id): False [ 1126.924546] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.924768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.924768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.924960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.925067] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.925316] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.925456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.925456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.925604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.925715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.925889] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.925965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.926023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.926162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.926232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.926421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.926514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.926572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.926737] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.926787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.926859] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1127.000412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.000614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.000659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.000861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.001035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.014068] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1127.577450] env[65107]: INFO networking_nsxv3.common.synchronization [None req-64d72477-0d17-422e-ab26-7f20aedc2b20 tempest-AttachInterfacesTestJSON-888211776 tempest-AttachInterfacesTestJSON-888211776-project-member] Enqueued Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1127.578031] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed with Priority: HIGHEST for action security_group_members [ 1127.578686] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-814a62b8-5b9a-4a8b-96c6-18956744a0ed taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.578686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.578686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.578803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.578964] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.579192] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.579261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.579420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.579526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.579636] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('814a62b8-5b9a-4a8b-96c6-18956744a0ed',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.082502] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.082900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.082900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.082979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.083025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.083232] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.083332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.083396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.083549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.083625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.083712] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed is going to be updated. [ 1128.110624] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.110791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.110889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.111168] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.111341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.121317] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: IN_PROGRESS for 2s [ 1129.029721] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1129.029721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.131528] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed in Status: SUCCESS [ 1130.131820] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 814a62b8-5b9a-4a8b-96c6-18956744a0ed deletion is rescheduled due to dependency. [ 1130.131820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-814a62b8-5b9a-4a8b-96c6-18956744a0ed" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.823187] env[65107]: INFO networking_nsxv3.common.synchronization [req-d39fbba8-dff4-4da9-94cf-de260d7230a9 req-466ce0db-2949-4eb6-87e4-16f985211dca tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1130.823546] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1130.824248] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.824498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.824591] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.824797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.824965] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.825087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.825150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.825305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.825396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.825492] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.328236] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.644754] env[65107]: INFO networking_nsxv3.common.synchronization [req-b9d77b34-705d-4b1b-a2a7-1c3b94fa6a8b req-d5680412-b772-42bb-bfa0-dd00aae19e11 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1131.645313] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1131.645677] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.645805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.645882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.646124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.646287] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.646390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.646452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.646615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.646749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.646884] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.829856] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.150406] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.150406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.150406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.150406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.150685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.150714] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.150804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.150865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.151023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.151103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.151189] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1132.184448] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.184448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.184448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.184448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.184448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.194395] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1132.266299] env[65107]: INFO networking_nsxv3.common.synchronization [None req-03f369aa-86ea-40c2-abd2-0565e68de474 None None] Enqueued Resource ID: 58cd57ac-df6f-454a-b015-ce20b1c1f48f with Priority: HIGHEST for action port [ 1132.266299] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58cd57ac-df6f-454a-b015-ce20b1c1f48f with Priority: HIGHEST for action port [ 1132.266299] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-58cd57ac-df6f-454a-b015-ce20b1c1f48f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.266299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58cd57ac-df6f-454a-b015-ce20b1c1f48f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.266299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58cd57ac-df6f-454a-b015-ce20b1c1f48f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.266299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58cd57ac-df6f-454a-b015-ce20b1c1f48f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.266299] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58cd57ac-df6f-454a-b015-ce20b1c1f48f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.332979] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.333396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.333396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.333863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.334028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.334189] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1132.373130] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.373130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.373130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.373130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.373363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.386650] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1132.767966] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58cd57ac-df6f-454a-b015-ce20b1c1f48f [ 1132.768213] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.768350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.768418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.768629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.768733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.768839] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58cd57ac-df6f-454a-b015-ce20b1c1f48f already deleted. [ 1132.768926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58cd57ac-df6f-454a-b015-ce20b1c1f48f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.208969] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1134.209350] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1134.209350] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.240563] env[65107]: INFO networking_nsxv3.common.synchronization [None req-d769399c-4bc7-4067-ae2f-77aa68164bd4 None None] Enqueued Resource ID: 7736d015-ea44-433e-a39a-a9d4e3a670ae with Priority: HIGHEST for action port [ 1134.241180] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7736d015-ea44-433e-a39a-a9d4e3a670ae with Priority: HIGHEST for action port [ 1134.241496] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7736d015-ea44-433e-a39a-a9d4e3a670ae taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.241617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7736d015-ea44-433e-a39a-a9d4e3a670ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.241681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7736d015-ea44-433e-a39a-a9d4e3a670ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.244583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7736d015-ea44-433e-a39a-a9d4e3a670ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.244583] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7736d015-ea44-433e-a39a-a9d4e3a670ae',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.395493] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1134.395685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.747200] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7736d015-ea44-433e-a39a-a9d4e3a670ae [ 1134.747304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.747417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.747483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.747695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.747782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.747877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7736d015-ea44-433e-a39a-a9d4e3a670ae already deleted. [ 1134.747956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7736d015-ea44-433e-a39a-a9d4e3a670ae" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.242853] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1139.243316] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1140.020183] env[65107]: INFO networking_nsxv3.common.synchronization [req-2e10adee-1962-4fa7-b87e-a326110b8d97 req-338f1ab1-e9d1-4eb9-9a7a-df5c582d6825 tempest-ServerMetadataTestJSON-336145547 tempest-ServerMetadataTestJSON-336145547-project-member] Enqueued Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_members [ 1140.020803] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_members [ 1140.021231] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.021370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.021498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.022073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.022073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.022073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.022222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.022334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.022428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.022556] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.355747] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.355747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.355747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.356211] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.356248] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.356415] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.356533] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.356826] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.356997] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.357227] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.357357] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.357511] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.357544] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.357676] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.357778] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.357903] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.380768] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.380968] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.381133] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.381320] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.381658] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-ad2439de-9e57-4467-a8cf-0a82b638f5b1 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.381828] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.381968] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.382424] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.382599] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad2439de-9e57-4467-a8cf-0a82b638f5b1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.528632] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.528808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.528955] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.529297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.529413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.529673] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.529821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.529902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.530128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.530222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.530346] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 already deleted. [ 1140.530452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.885248] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.885473] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.885575] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.885873] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.886062] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.886192] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port ad2439de-9e57-4467-a8cf-0a82b638f5b1 not found, creating... [ 1140.886455] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.886614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.886749] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.886975] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.887129] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.887409] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.887570] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.887679] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.887876] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.888016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.888157] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: ad2439de-9e57-4467-a8cf-0a82b638f5b1 is going to be created. [ 1140.909910] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.910226] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.910357] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.910634] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.910867] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.911107] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.633421] env[65107]: INFO networking_nsxv3.common.synchronization [req-2e10adee-1962-4fa7-b87e-a326110b8d97 req-7c5defd0-3673-4b79-ae8c-d83d858d6bbb service nova] Enqueued Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_rules [ 1141.633708] env[65107]: INFO networking_nsxv3.common.synchronization [req-2e10adee-1962-4fa7-b87e-a326110b8d97 req-7c5defd0-3673-4b79-ae8c-d83d858d6bbb service nova] Enqueued Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_members [ 1141.633758] env[65107]: INFO networking_nsxv3.common.synchronization [req-2e10adee-1962-4fa7-b87e-a326110b8d97 req-7c5defd0-3673-4b79-ae8c-d83d858d6bbb service nova] Enqueued Resource ID: ad2439de-9e57-4467-a8cf-0a82b638f5b1 with Priority: HIGHEST for action port [ 1141.634741] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_rules [ 1141.634885] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_members [ 1141.634988] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2439de-9e57-4467-a8cf-0a82b638f5b1 with Priority: HIGHEST for action port [ 1141.635305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.635411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.635480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.635742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.635823] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.636681] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.636763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.636830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.636994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.637166] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.637261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.637323] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.637461] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.637560] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.637655] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.638424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad2439de-9e57-4467-a8cf-0a82b638f5b1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.638530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.639226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.639226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.639226] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad2439de-9e57-4467-a8cf-0a82b638f5b1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.140360] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.141438] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.141638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.141937] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad2439de-9e57-4467-a8cf-0a82b638f5b1 with status ACTIVE [ 1142.142156] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.142274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.142340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.142544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.142627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.142792] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.142885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.142948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.143108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.143187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.143364] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.143455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.143518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.143652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.143719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.143802] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad2439de-9e57-4467-a8cf-0a82b638f5b1 is going to be updated. [ 1142.166307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.166521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.166521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.166752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.166927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.167103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad2439de-9e57-4467-a8cf-0a82b638f5b1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.315808] env[65107]: INFO networking_nsxv3.common.synchronization [req-47a43353-4f1a-4d9e-b70b-f09d45996372 req-c41bf686-288c-429c-b75c-e2ad20e3f3b6 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1142.316368] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1142.316680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.316803] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.316870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.317092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.317250] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.317468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.317542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.317700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.317787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.317880] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.643240] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.659048] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.659265] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.659384] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.659662] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.659925] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.660107] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.660219] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.660424] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.660566] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.660765] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.660874] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.660980] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.661103] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.661231] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.661281] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.661402] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.680658] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.680658] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.680658] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.681124] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.682780] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.682780] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.682780] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.682780] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.682780] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c3c3d8-04fa-4d23-a0eb-33ca562b49f1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.820362] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.820576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.820685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.820970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.821090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.821429] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.821577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.821670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.821857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.822140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.822140] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1142.850561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.850772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.850855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.851138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.851284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.861911] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1143.145447] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.145703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.145785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.145983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.146104] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.146216] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 is going to be created. [ 1143.169083] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.169352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.169352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.169504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.169683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.180764] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 in Status: UNINITIALIZED for 2s [ 1143.184470] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.184650] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.184775] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.185060] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.185216] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.185362] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 not found, creating... [ 1143.185668] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.185827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.185942] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.186170] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.186307] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.186589] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.186740] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.186849] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.187058] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.187198] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.187337] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 is going to be created. [ 1143.206210] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.206427] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.206542] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.206902] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.207151] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.207371] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.929077] env[65107]: INFO networking_nsxv3.common.synchronization [req-47a43353-4f1a-4d9e-b70b-f09d45996372 req-9e3072a9-ad5a-4b2a-b2b0-3f8f4ca7672f service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1143.929351] env[65107]: INFO networking_nsxv3.common.synchronization [req-47a43353-4f1a-4d9e-b70b-f09d45996372 req-9e3072a9-ad5a-4b2a-b2b0-3f8f4ca7672f service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1143.929452] env[65107]: INFO networking_nsxv3.common.synchronization [req-47a43353-4f1a-4d9e-b70b-f09d45996372 req-9e3072a9-ad5a-4b2a-b2b0-3f8f4ca7672f service nova] Enqueued Resource ID: 17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 with Priority: HIGHEST for action port [ 1143.930396] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1143.930396] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1143.930396] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 with Priority: HIGHEST for action port [ 1143.930396] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.930693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.930693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.930770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.930847] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.931901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.932959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.932959] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.932959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.932959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.933748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.933748] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c3c3d8-04fa-4d23-a0eb-33ca562b49f1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.436195] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.436399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.436579] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 with status ACTIVE [ 1144.436777] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.436910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.437037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.437253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.437360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.437565] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.437669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.437752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.437946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.438076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.438297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.438407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.438495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.438656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.438740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.438847] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17c3c3d8-04fa-4d23-a0eb-33ca562b49f1 is going to be updated. [ 1144.460393] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.460562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.460605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.460813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.460952] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.461222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17c3c3d8-04fa-4d23-a0eb-33ca562b49f1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.620435] env[65107]: INFO networking_nsxv3.common.synchronization [req-e2c0bd49-9bee-4c72-8689-1a6ba183f8f6 req-2ccdb674-ba5e-4f40-b44a-60093d78aae2 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1144.621192] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1144.621324] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.621435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.621525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.621701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.621858] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.621956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.622162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.622352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.622485] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.622588] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.873095] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1144.873388] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1144.873451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.873628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.873851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.874055] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.874175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.874241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.874399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.874540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.874636] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.942080] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.942484] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.942659] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.942934] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.943218] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.943376] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.943490] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.943731] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.943878] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.944095] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.944206] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.944369] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.944416] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.944585] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.944695] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.944826] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.968926] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.968926] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1144.968926] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.968926] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.969162] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-45ca11a7-5587-42ed-82e8-28ea93efe308 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.969641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.969641] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.969783] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.969920] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ca11a7-5587-42ed-82e8-28ea93efe308',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.124967] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.192070] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 in Status: SUCCESS [ 1145.192070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.192070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.192258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.193088] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.193088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.193088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.193088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.193088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.193088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.193088] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.376746] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.473394] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.473666] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.473806] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.474092] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.474246] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.474393] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 45ca11a7-5587-42ed-82e8-28ea93efe308 not found, creating... [ 1145.474675] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.474831] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.474945] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.475192] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.475328] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.475616] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.475762] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.475877] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.476101] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.476231] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.476411] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 45ca11a7-5587-42ed-82e8-28ea93efe308 is going to be created. [ 1145.495968] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.496185] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.496307] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.496568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.496794] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.497021] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.628488] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.696225] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.696427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.696548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.696869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.697134] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.697276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.697358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.697611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.697732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.697817] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.698046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.698182] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.698315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.698471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.698790] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.698870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.698939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.699075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.699208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.699309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.699437] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.879100] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.131197] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.131197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.131197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.131677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.131677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.131677] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1146.161026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.161185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.161255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.161476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.161627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.172821] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1146.202479] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3f12117-47c0-49e5-a9ee-6998ac5d5281: rpc.has_security_group_logging(os_id): False [ 1146.224389] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.224831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.225077] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.225510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.225759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.230573] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.230573] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.230573] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.230573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.231074] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.231074] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 is going to be created. [ 1146.261656] env[65107]: INFO networking_nsxv3.common.synchronization [req-e2c0bd49-9bee-4c72-8689-1a6ba183f8f6 req-d0c2bd1e-a6be-422b-a9eb-b8c9f56af5e7 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1146.261850] env[65107]: INFO networking_nsxv3.common.synchronization [req-e2c0bd49-9bee-4c72-8689-1a6ba183f8f6 req-d0c2bd1e-a6be-422b-a9eb-b8c9f56af5e7 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1146.262470] env[65107]: INFO networking_nsxv3.common.synchronization [req-e2c0bd49-9bee-4c72-8689-1a6ba183f8f6 req-d0c2bd1e-a6be-422b-a9eb-b8c9f56af5e7 service nova] Enqueued Resource ID: 45ca11a7-5587-42ed-82e8-28ea93efe308 with Priority: HIGHEST for action port [ 1146.263040] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1146.263188] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1146.263280] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ca11a7-5587-42ed-82e8-28ea93efe308 with Priority: HIGHEST for action port [ 1146.263831] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.263969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.264121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.264328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.264411] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.265333] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.265546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.265649] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ca11a7-5587-42ed-82e8-28ea93efe308 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.265755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.265819] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.266010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.266118] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ca11a7-5587-42ed-82e8-28ea93efe308',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.297343] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.297573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.297630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.297850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.298039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.321377] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 in Status: IN_PROGRESS for 2s [ 1146.383474] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.383636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.383711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.383929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.384040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.384141] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1146.442960] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.443148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.443219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.443665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.443665] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.455689] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1146.768799] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.769053] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.769334] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45ca11a7-5587-42ed-82e8-28ea93efe308 with status ACTIVE [ 1146.769683] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.769683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.769837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.769976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.770116] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.770303] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.770399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.770460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.770627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.770707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.770911] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.771021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.771083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.771227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.771303] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.771387] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45ca11a7-5587-42ed-82e8-28ea93efe308 is going to be updated. [ 1146.797773] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.797964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.798014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.798283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.798433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.798604] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ca11a7-5587-42ed-82e8-28ea93efe308" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.183587] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1148.184235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.184235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.184570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.184803] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.184946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.185029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.185205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.185291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.185388] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.335345] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 in Status: SUCCESS [ 1148.335577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.469865] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1148.470090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.470258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.470474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.470666] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.470784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.470851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.470998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.471093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.471176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.471266] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.687432] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.973615] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.973822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.973900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.974203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.974430] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.974615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.974674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.974887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.975010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.975137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.975323] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.975449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.975519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.975699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.975861] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.975989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.976070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.976241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.976315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.976399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.976488] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.189793] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.479088] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c066e724-cbaf-469e-be19-001bda52a5c7: rpc.has_security_group_logging(os_id): False [ 1149.501271] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.501521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.501657] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.501978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.502161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.502457] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.502625] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.502751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.503040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.503177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.503576] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.503715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.503813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.504079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.504170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.504371] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.504578] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.504692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.504802] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.504889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.504999] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1149.580445] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.580445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.580445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.580948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.580948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.595707] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1149.693876] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.694071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.694137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.694351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.694438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.694609] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1149.745771] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.746037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.746037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.746251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.746891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.770274] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1150.882670] env[65107]: INFO networking_nsxv3.common.synchronization [req-c5e3e8a0-0214-4553-a9e4-a986e432924e req-6ee6735d-b410-4fa2-80f9-ab455bdcba73 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_members [ 1150.883171] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGHEST for action security_group_members [ 1150.883484] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.883618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.883820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.883877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.884554] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.884554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.884554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.884774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.884871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.885256] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.387852] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.388097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.388215] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.388391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.388501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.388791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.388949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.389058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.389230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.389313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.389403] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 is going to be updated. [ 1151.420690] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.420906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.420906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.421139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.421286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.430744] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 in Status: IN_PROGRESS for 2s [ 1151.610546] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1151.610798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.783729] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1151.783729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.783729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.783729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.783729] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.784050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.784344] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.784405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.784554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.784671] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.784785] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.287742] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.288172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.288172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.288305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.288387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.288492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.288559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.288703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.288881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.288981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.289148] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.289241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.289300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.289439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.289574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.289663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.289722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.289853] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.289931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.290032] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.290125] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.792824] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cacf6191-ed0d-498d-a524-904b8f81b797: rpc.has_security_group_logging(os_id): False [ 1152.812310] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.812533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.812649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.812875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.812977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.813204] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.813309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.813374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.813529] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.813610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.813809] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.813904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.813966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.814134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.814199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.814409] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.814555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.814596] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.814719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.814841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.814874] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1152.881104] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.881282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.881356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.881655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.881836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.898493] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1153.215129] env[65107]: INFO networking_nsxv3.common.synchronization [req-b830bc34-3c4c-4870-8d2e-949f9ed24cf7 req-25ae0eeb-a0eb-40f4-b936-84ffee79eef0 tempest-ServerMetadataTestJSON-336145547 tempest-ServerMetadataTestJSON-336145547-project-member] Enqueued Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_members [ 1153.215239] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGHEST for action security_group_members [ 1153.215800] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.215927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.215927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.216465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.216465] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.216465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.216654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.216712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.216831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.217098] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.441171] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 in Status: SUCCESS [ 1153.441580] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 deletion is rescheduled due to dependency. [ 1153.441580] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.720391] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.720597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.720597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.720824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.720921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.721137] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.721237] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.721300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.721452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.721528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.721617] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 is going to be updated. [ 1153.748177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.748375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.748433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.748727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.748839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.757142] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 in Status: IN_PROGRESS for 2s [ 1154.912296] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1154.912296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.767934] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 in Status: SUCCESS [ 1155.768074] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 deletion is rescheduled due to dependency. [ 1155.768119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.490050] env[65107]: INFO networking_nsxv3.common.synchronization [req-6e06afb1-8378-4a88-8ef8-b0a7cf057732 req-50de78a4-3aea-4d20-9a0a-7b9008ea9d73 tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 1156.490758] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGHEST for action security_group_members [ 1156.491185] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.491293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.491293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.491528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.491828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.491828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.491828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.492275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.492275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.492275] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.995129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.995129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.995448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.995583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.995633] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.995846] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.995968] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.996059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.996366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.996366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.996477] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e is going to be updated. [ 1157.024179] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.024346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.024393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.024640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.024791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.036349] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: IN_PROGRESS for 2s [ 1157.195025] env[65107]: INFO networking_nsxv3.common.synchronization [req-6ba964e4-e426-4d63-85a0-f44ff7db6d24 req-5e5ff825-ccdf-434c-898e-a9944881e2f4 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1157.195025] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1157.195025] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.195025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.195025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.195025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.195025] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.195025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.195025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.195025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.195025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.195025] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.696769] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.697187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.697187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.697274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.697321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.697535] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.698291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.698291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.698291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.698291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.698291] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1157.727488] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.727699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.727782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.728016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.728183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.738292] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1159.048139] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e in Status: SUCCESS [ 1159.048605] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e deletion is rescheduled due to dependency. [ 1159.048605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.748918] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1159.749050] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1159.749172] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.803775] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a2f4b7f-ab4b-4673-b204-fa1d5574d25b req-f304c567-e1c8-4027-99b0-f786de28ac6d tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1159.804121] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1159.804489] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.804646] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.804724] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.804987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.805194] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.805242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.805318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.805489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.805620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.805721] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.030044] env[65107]: INFO networking_nsxv3.common.synchronization [req-f0652d0f-ee7b-4fba-8f05-17273de39ca7 req-11897c56-33a8-475b-8668-0e10c5e2adbb tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_members [ 1160.030554] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf6500c-0f04-40de-ab53-f85da7100112 with Priority: HIGHEST for action security_group_members [ 1160.030876] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcf6500c-0f04-40de-ab53-f85da7100112 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.031017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.032086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.032086] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.032154] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.032537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.032537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.032645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.032710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.032887] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcf6500c-0f04-40de-ab53-f85da7100112',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.115685] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.116040] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.116078] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.116342] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.116591] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.116832] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.116917] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.117069] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.117211] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.117408] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.117515] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.117617] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.117717] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.117826] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.117929] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.118062] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.138374] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.138567] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1160.138705] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.138877] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.139214] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-51b572a2-639f-4dab-b8bf-e961b5c11b78 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.139413] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.139494] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.139856] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.140018] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b572a2-639f-4dab-b8bf-e961b5c11b78',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.308049] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.537967] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.537967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.537967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.537967] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.561605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.561948] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.562348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.562486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.562775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.562946] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.563257] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcf6500c-0f04-40de-ab53-f85da7100112 is going to be updated. [ 1160.592510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.592720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.592821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.593539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.593539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.602837] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcf6500c-0f04-40de-ab53-f85da7100112 in Status: IN_PROGRESS for 2s [ 1160.642205] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.642485] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.642629] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.642918] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.643097] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.643315] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 51b572a2-639f-4dab-b8bf-e961b5c11b78 not found, creating... [ 1160.643551] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.643709] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.643825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.644054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.644187] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.644467] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.644763] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.644950] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.645195] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.645341] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.645484] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 51b572a2-639f-4dab-b8bf-e961b5c11b78 is going to be created. [ 1160.666445] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.666645] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.666767] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.667092] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.667339] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.667562] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.810145] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.312513] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.312997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.312997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.312997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.312997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.313226] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1161.355671] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.355923] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.356070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.356340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.356552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.370935] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1161.410243] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a2f4b7f-ab4b-4673-b204-fa1d5574d25b req-58eb8477-56f3-4e8e-a907-256cc9b07d0d service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1161.410243] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a2f4b7f-ab4b-4673-b204-fa1d5574d25b req-58eb8477-56f3-4e8e-a907-256cc9b07d0d service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1161.410243] env[65107]: INFO networking_nsxv3.common.synchronization [req-7a2f4b7f-ab4b-4673-b204-fa1d5574d25b req-58eb8477-56f3-4e8e-a907-256cc9b07d0d service nova] Enqueued Resource ID: 51b572a2-639f-4dab-b8bf-e961b5c11b78 with Priority: HIGHEST for action port [ 1161.410808] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1161.410969] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1161.411099] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b572a2-639f-4dab-b8bf-e961b5c11b78 with Priority: HIGHEST for action port [ 1161.411403] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.411527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.411594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.411856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.411966] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.412929] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.413034] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.413242] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-51b572a2-639f-4dab-b8bf-e961b5c11b78 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.413346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.413409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.413595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.413676] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b572a2-639f-4dab-b8bf-e961b5c11b78',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.916304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.916304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.917419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51b572a2-639f-4dab-b8bf-e961b5c11b78 with status ACTIVE [ 1161.917657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.917782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.917860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.918175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.918270] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.918746] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.918746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.918746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.919015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.919143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.919388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.919516] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.919606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.919782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.919860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.919947] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51b572a2-639f-4dab-b8bf-e961b5c11b78 is going to be updated. [ 1161.942233] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.942233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.942233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.942233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.942233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.942233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51b572a2-639f-4dab-b8bf-e961b5c11b78" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.068856] env[65107]: INFO networking_nsxv3.common.synchronization [req-bc405f1d-ca60-434d-9130-eeccb1e70f51 req-cb26e3fd-6aa4-439d-89e2-31014dd87ae5 tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1162.069398] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1162.070079] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.070958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.070958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.070958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.071153] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.071300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.071392] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.071588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.071760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.071910] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.088321] env[65107]: INFO networking_nsxv3.common.synchronization [req-d40ef67c-ca8c-46ba-a008-227e829db95e req-4c1ad1b6-3e0d-4d52-b388-00e86e9114eb tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 1162.088690] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 1162.088919] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.089062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.089124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.089475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.089662] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.090066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.090066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.090217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.090286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.090693] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.447800] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.447800] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.448169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.448169] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.448502] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.448668] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.449410] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.449410] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.449410] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.449410] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.449718] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.449919] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.450085] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.450253] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.450389] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.450556] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.471167] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.471167] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.471167] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.471372] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.471578] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-7c258386-cd1c-4e1d-ada1-9224abacb9a3 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.471747] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.471874] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.472232] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.472368] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c258386-cd1c-4e1d-ada1-9224abacb9a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.574689] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.574895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.574962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.575170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.575368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.575597] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.575700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.575756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.575910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.575997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.576076] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1162.593399] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.593598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.593598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.593828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.606675] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.606854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.606899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.607120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.607256] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.620435] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1162.622232] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcf6500c-0f04-40de-ab53-f85da7100112 in Status: SUCCESS [ 1162.622397] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcf6500c-0f04-40de-ab53-f85da7100112 deletion is rescheduled due to dependency. [ 1162.622552] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcf6500c-0f04-40de-ab53-f85da7100112" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.624546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.624873] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.625023] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.625081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.625282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.625365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.625452] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 is going to be updated. [ 1162.676861] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.677063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.677107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.677292] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.677431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.691724] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: IN_PROGRESS for 2s [ 1162.975033] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.975033] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.975033] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.975468] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.975748] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.976044] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 7c258386-cd1c-4e1d-ada1-9224abacb9a3 not found, creating... [ 1162.976407] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.976677] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.976936] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.977273] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.977505] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.977965] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.978193] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.978425] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.978768] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.979009] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.979270] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 7c258386-cd1c-4e1d-ada1-9224abacb9a3 is going to be created. [ 1163.000760] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.001387] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.001387] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.001683] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.001789] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.002038] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.384297] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1163.384394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.384638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.384937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.385218] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.385378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.385474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.385703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.385826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.385958] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.754345] env[65107]: INFO networking_nsxv3.common.synchronization [req-d40ef67c-ca8c-46ba-a008-227e829db95e req-550168ff-d076-400e-8bed-1ca49849e068 service nova] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_rules [ 1163.754652] env[65107]: INFO networking_nsxv3.common.synchronization [req-d40ef67c-ca8c-46ba-a008-227e829db95e req-550168ff-d076-400e-8bed-1ca49849e068 service nova] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 1163.754652] env[65107]: INFO networking_nsxv3.common.synchronization [req-d40ef67c-ca8c-46ba-a008-227e829db95e req-550168ff-d076-400e-8bed-1ca49849e068 service nova] Enqueued Resource ID: 7c258386-cd1c-4e1d-ada1-9224abacb9a3 with Priority: HIGHEST for action port [ 1163.755079] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_rules [ 1163.755222] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 1163.755312] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c258386-cd1c-4e1d-ada1-9224abacb9a3 with Priority: HIGHEST for action port [ 1163.755633] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.755773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.755841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.756066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.756151] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.757057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.757178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.757368] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c258386-cd1c-4e1d-ada1-9224abacb9a3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.757469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.757530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.757710] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.757805] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c258386-cd1c-4e1d-ada1-9224abacb9a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.888749] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.909449] env[65107]: INFO networking_nsxv3.common.synchronization [None req-d1c91e8c-5f6e-4393-98b8-a6978d84039f tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1163.909833] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1163.910178] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.910305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.910372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.910626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.910710] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.015835] env[65107]: INFO networking_nsxv3.common.synchronization [None req-403954ac-4f8a-4f9b-9a97-d1ed5a55e385 tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1164.016797] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1164.017404] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.017553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.259502] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.259686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.259926] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c258386-cd1c-4e1d-ada1-9224abacb9a3 with status ACTIVE [ 1164.260199] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.260340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.260430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.260675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.260780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.260990] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.261157] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.261206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.261348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.261435] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.261674] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.261801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.261905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.262093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.262142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.262251] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c258386-cd1c-4e1d-ada1-9224abacb9a3 is going to be updated. [ 1164.286425] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.286569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.286569] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.286709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.287527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.287527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.391373] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.442879] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.443185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.443304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.443789] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.443842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.443978] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30172372-1775-4005-bb5c-5e216ae55211 already deleted. [ 1164.444140] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.444346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.444574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.444848] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.631051] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1164.631222] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d deletion is rescheduled due to dependency. [ 1164.631267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.701075] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: SUCCESS [ 1164.701227] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 deletion is rescheduled due to dependency. [ 1164.701362] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.701587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.701832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.702100] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.702376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.702512] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.702743] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.702847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.704166] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.894113] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.894503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.894503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.894683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.894683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.894770] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1164.922945] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.923119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.923224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.923534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.923905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.934067] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1164.965713] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.966212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.966212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.966212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.966333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.966391] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30172372-1775-4005-bb5c-5e216ae55211 already deleted. [ 1164.966475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.206972] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.709526] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.212206] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.212634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.212634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.212634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.212777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.212841] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 is going to be updated. [ 1166.244696] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.244936] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.245017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.245576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.245576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.262812] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: IN_PROGRESS for 2s [ 1166.944303] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1166.944457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.944751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.945018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.945263] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.945412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.945503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.945812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.945961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.946087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.946185] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.448986] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.448986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.448986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.449307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.449307] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.449908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.449908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.449908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.449908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.449908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.449908] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.450211] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.450211] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.450211] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.450342] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.450430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.450593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.450656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.450689] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.450760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.450852] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.953585] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cacf6191-ed0d-498d-a524-904b8f81b797: rpc.has_security_group_logging(os_id): False [ 1167.973131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.973253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.973364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.973614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.973772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.974057] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.974178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.974262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.974433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.974514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.974791] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.974891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.974978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.975154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.975229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.975430] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.975527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.975588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.975752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.975873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.975873] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1167.986160] env[65107]: INFO networking_nsxv3.common.synchronization [None req-4c114fac-d721-4b30-83c6-af3a13bdd64a tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_rules [ 1167.986876] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_rules [ 1167.987355] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b54cadd8-8b2d-427a-b017-3c0370790709 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.987448] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.987506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.987835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.987910] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.045561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.045785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.045848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.046095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.046252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.062110] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1168.070984] env[65107]: INFO networking_nsxv3.common.synchronization [None req-81cc7719-27ce-4084-8093-6eb0b0dd8000 tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_rules [ 1168.071836] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_rules [ 1168.072181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b54cadd8-8b2d-427a-b017-3c0370790709 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.072321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.273077] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: SUCCESS [ 1168.273852] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.274038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.274261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.274461] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.274581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.274707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.274947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.275066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.275149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.275296] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.509927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.510278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.510278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.510405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.510509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.510611] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b54cadd8-8b2d-427a-b017-3c0370790709 already deleted. [ 1168.510693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.510844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.511006] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.511093] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.778570] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.778727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.778797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.779108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.779359] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.779423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.779549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.779682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.779807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.780072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.780147] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.780261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.780375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.780531] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.780664] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.780752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.780801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.780996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.780996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.781128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.781223] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.033220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.033425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.033521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.033777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.033910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.034092] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b54cadd8-8b2d-427a-b017-3c0370790709 already deleted. [ 1169.034213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.284281] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5c10011-beb4-47e7-8405-2bfc31ee7de0: rpc.has_security_group_logging(os_id): False [ 1169.302782] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.302993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.303193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.303447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.303607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.303879] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.304068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.304175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.304377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.304502] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.304811] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.304962] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.305107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.305293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.305417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.305663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.305807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.305904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.306117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.306244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.306371] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 is going to be updated. [ 1169.368552] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.368731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.368776] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.368991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.369227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.383382] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: IN_PROGRESS for 2s [ 1170.079735] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1170.079735] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.769531] env[65107]: INFO networking_nsxv3.common.synchronization [req-b0a9743d-f974-46f9-8a47-0ff582d5c7a2 req-8defa7af-6172-4f44-94c2-0f76a5d64a9c tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1170.770155] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1170.770663] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.770663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.770778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.770996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.771432] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.771432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.771597] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.771782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.771848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.771951] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.079439] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.079540] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.079611] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.079968] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.080237] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.080389] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.080499] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.080709] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.080855] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.081065] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.081173] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.081333] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.081383] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.081466] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.081567] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.081691] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.100511] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.100692] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1171.100813] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.100995] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.101347] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-6e3dec7a-fe46-4b30-8cae-72355686b30c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.101516] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.101699] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.102054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.102243] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e3dec7a-fe46-4b30-8cae-72355686b30c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.275844] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.276058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.276106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.276360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.276469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.276704] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.276828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.276914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.277097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.277206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.277304] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30172372-1775-4005-bb5c-5e216ae55211 already deleted. [ 1171.277406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.396562] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: SUCCESS [ 1171.396838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.604808] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.605014] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.605132] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.605429] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.605590] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.605754] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 6e3dec7a-fe46-4b30-8cae-72355686b30c not found, creating... [ 1171.606052] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.606189] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.606304] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.606520] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.606654] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.606929] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.607093] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.607206] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.607406] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.607534] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.607668] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c is going to be created. [ 1171.626733] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.626938] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.627054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.627324] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.627553] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.627768] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.365584] env[65107]: INFO networking_nsxv3.common.synchronization [req-b0a9743d-f974-46f9-8a47-0ff582d5c7a2 req-19274ba5-50d9-4fa6-8f49-4f2df43162b8 service nova] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1172.366064] env[65107]: INFO networking_nsxv3.common.synchronization [req-b0a9743d-f974-46f9-8a47-0ff582d5c7a2 req-19274ba5-50d9-4fa6-8f49-4f2df43162b8 service nova] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1172.366237] env[65107]: INFO networking_nsxv3.common.synchronization [req-b0a9743d-f974-46f9-8a47-0ff582d5c7a2 req-19274ba5-50d9-4fa6-8f49-4f2df43162b8 service nova] Enqueued Resource ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c with Priority: HIGHEST for action port [ 1172.366978] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1172.368028] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1172.368028] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c with Priority: HIGHEST for action port [ 1172.368028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.368028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.368028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.368028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.368028] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.368835] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.368947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.369079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.369294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.369387] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.369495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.369557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.369703] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.369790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.370110] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.371615] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e3dec7a-fe46-4b30-8cae-72355686b30c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.371615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.371615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.371820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.371856] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e3dec7a-fe46-4b30-8cae-72355686b30c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.531132] env[65107]: INFO networking_nsxv3.common.synchronization [req-51b9a8c7-3669-4801-99ad-42dcac0eea8f req-e725a941-4396-46d8-b628-c3eea37def42 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1172.532221] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1172.532733] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.532947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.533554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.533554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.533789] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.534143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.534236] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.534456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.534616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.534734] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.873436] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.874871] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.875021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.875382] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e3dec7a-fe46-4b30-8cae-72355686b30c with status ACTIVE [ 1172.875567] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.875687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.875741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.875948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.876052] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.876220] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.876313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.876387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.876579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.876579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.876770] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.876865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.876925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.879605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.879605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.879605] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c is going to be updated. [ 1172.900241] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.900241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.900241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.900639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.900639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.900639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.956131] env[65107]: INFO networking_nsxv3.common.synchronization [req-cef8048a-f9eb-4081-ae62-929fb89a96da req-77b427b7-9bd1-499e-b2ca-9159cebc3973 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1172.956658] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1172.957469] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.957469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.957469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.957469] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.957683] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.957683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.957683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.957791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.957876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.957973] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.037853] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.259530] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.259797] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.260189] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.260346] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.260608] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.260764] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.260887] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.261138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.261293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.261501] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.261611] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.261719] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.261827] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.261968] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.262143] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.262303] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.286091] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.286284] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1173.286420] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.286606] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.287280] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-7b718397-91aa-483d-9dbd-af89266ee685 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.287475] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.287595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.287932] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.288090] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b718397-91aa-483d-9dbd-af89266ee685',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.377063] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.461063] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.461231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.461308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.461535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.461713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.462080] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.462227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.462311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.462506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.462614] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.462762] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1173.504566] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.504566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.504566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.504566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.504566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.512771] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1173.534481] env[65107]: INFO networking_nsxv3.common.synchronization [req-711e27db-e00b-4197-b641-f85e57af551c req-4802180b-37f7-4756-9b03-4798b7f752ac tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 1173.534713] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 with Priority: HIGHEST for action security_group_members [ 1173.535273] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5c10011-beb4-47e7-8405-2bfc31ee7de0 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.535608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.535835] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.536978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.536978] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.536978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.537127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.537238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.537328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.537428] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5c10011-beb4-47e7-8405-2bfc31ee7de0',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.538988] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.597811] env[65107]: INFO networking_nsxv3.common.synchronization [req-711e27db-e00b-4197-b641-f85e57af551c req-4802180b-37f7-4756-9b03-4798b7f752ac tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 7c258386-cd1c-4e1d-ada1-9224abacb9a3 with Priority: HIGHEST for action port [ 1173.598607] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c258386-cd1c-4e1d-ada1-9224abacb9a3 with Priority: HIGHEST for action port [ 1173.599052] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c258386-cd1c-4e1d-ada1-9224abacb9a3 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.599244] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.599757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.599812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.599940] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c258386-cd1c-4e1d-ada1-9224abacb9a3',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.792898] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.793251] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.793381] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.793796] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.793860] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.794049] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 7b718397-91aa-483d-9dbd-af89266ee685 not found, creating... [ 1173.794327] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.794485] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.794600] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.794875] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.795026] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.795312] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.795464] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.795576] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.796050] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.796050] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.796174] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 7b718397-91aa-483d-9dbd-af89266ee685 is going to be created. [ 1173.821386] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.821386] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.821386] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.821386] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.821386] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.821386] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.871539] env[65107]: INFO networking_nsxv3.common.synchronization [None req-5ed7ae33-6b62-4e07-b65b-ca10e386f7e1 tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_rules [ 1173.872023] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_rules [ 1173.872538] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.872759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.872981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.873186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.873269] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.880385] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.880385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.880385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.880385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.880385] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.880385] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30172372-1775-4005-bb5c-5e216ae55211 is going to be created. [ 1173.921665] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.921878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.921878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.922147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.922316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.933042] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: UNINITIALIZED for 2s [ 1174.040060] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.040241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.040340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.040534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.040628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.040826] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.041015] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.041096] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.041255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.041332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.041418] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 is going to be updated. [ 1174.042598] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.042717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.042773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.042922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.043013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.043105] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1174.076043] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.076043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.076043] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.076386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.076386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.078297] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.078372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.078431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.078587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.078711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.081612] env[65107]: INFO networking_nsxv3.common.synchronization [None req-8df7cb09-1605-4728-9b0a-30647dfe958b tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_rules [ 1174.082517] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_rules [ 1174.082835] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.082933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.089379] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1174.090620] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: IN_PROGRESS for 2s [ 1174.103484] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c258386-cd1c-4e1d-ada1-9224abacb9a3 with status ACTIVE [ 1174.103709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.103845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.103916] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.104159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.104249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.104428] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.104687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.104687] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.104786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.104854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.105048] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.105143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.105202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.105339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.105412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.105497] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c258386-cd1c-4e1d-ada1-9224abacb9a3 is going to be updated. [ 1174.126505] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.126692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.126739] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.126910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.127068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.127225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c258386-cd1c-4e1d-ada1-9224abacb9a3" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.409822] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.409822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.409822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.409822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.409822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.409822] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 already deleted. [ 1174.409822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.409822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.409822] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.410594] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.515570] env[65107]: INFO networking_nsxv3.common.synchronization [req-cef8048a-f9eb-4081-ae62-929fb89a96da req-e287107d-7ca9-47d1-ac35-17566c48a47b service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1174.515938] env[65107]: INFO networking_nsxv3.common.synchronization [req-cef8048a-f9eb-4081-ae62-929fb89a96da req-e287107d-7ca9-47d1-ac35-17566c48a47b service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1174.515938] env[65107]: INFO networking_nsxv3.common.synchronization [req-cef8048a-f9eb-4081-ae62-929fb89a96da req-e287107d-7ca9-47d1-ac35-17566c48a47b service nova] Enqueued Resource ID: 7b718397-91aa-483d-9dbd-af89266ee685 with Priority: HIGHEST for action port [ 1174.516446] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1174.516563] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1174.516665] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b718397-91aa-483d-9dbd-af89266ee685 with Priority: HIGHEST for action port [ 1174.516974] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.518051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.518051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.518217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.518320] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.520740] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.520839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.521141] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b718397-91aa-483d-9dbd-af89266ee685 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.521289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.521336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.523428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.523428] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b718397-91aa-483d-9dbd-af89266ee685',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.931140] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.931283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.931351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.931566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.931650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.931851] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 already deleted. [ 1174.931851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.024304] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.024304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.025562] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b718397-91aa-483d-9dbd-af89266ee685 with status ACTIVE [ 1175.025647] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.025798] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.025878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.026120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.026210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.026389] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.029551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.029551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.029551] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b718397-91aa-483d-9dbd-af89266ee685 is going to be updated. [ 1175.050806] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.050806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.050806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.050806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.050806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.051158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b718397-91aa-483d-9dbd-af89266ee685" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.282505] env[65107]: INFO networking_nsxv3.common.synchronization [req-36b4324a-98d9-4073-9bdb-30f7c6351bec req-ba0bfad7-d062-46fa-beed-a8a173f77e7d tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1175.283041] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1175.283385] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.283581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.283715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.284084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.284303] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.285016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.285016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.285016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.285016] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.285165] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.523379] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1175.523772] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1175.523772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.524245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.524245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.524359] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.524430] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.524478] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.524630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.524714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.524828] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.683619] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.683892] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.683937] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.684274] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.684615] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.684893] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.684929] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.685152] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.685741] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.686621] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.686669] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.687955] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.687955] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.687955] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.687955] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.687955] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.707975] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.708160] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.708292] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.708466] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.708929] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.709158] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.709276] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.709595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.709732] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a39c781-a4b2-4eeb-9ef9-21d14fde6206',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.787127] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.787297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.787420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.787615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.787715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.787929] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.788048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.788111] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.788267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.788341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.788426] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1175.819421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.819421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.819421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.819421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.819421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.831469] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1175.944668] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: SUCCESS [ 1175.944950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.945156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.945378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.945567] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.945693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.945773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.945934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.946029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.946120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.946211] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.028365] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.100814] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 in Status: SUCCESS [ 1176.100991] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5c10011-beb4-47e7-8405-2bfc31ee7de0 deletion is rescheduled due to dependency. [ 1176.101068] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5c10011-beb4-47e7-8405-2bfc31ee7de0" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.101840] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1176.102038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.212382] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.212671] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.212885] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.213145] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.213309] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.213587] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 not found, creating... [ 1176.213902] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.214088] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.214210] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.214465] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.214611] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.215012] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.215175] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.215342] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.215626] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.215842] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.216021] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 is going to be created. [ 1176.238147] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.238360] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.238484] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.238771] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.239011] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.239245] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.448780] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.530876] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.950574] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30172372-1775-4005-bb5c-5e216ae55211: rpc.has_security_group_logging(os_id): False [ 1176.970206] env[65107]: INFO networking_nsxv3.common.synchronization [req-36b4324a-98d9-4073-9bdb-30f7c6351bec req-fd93ca74-2269-4741-9dc8-66941edc0210 service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 1176.970206] env[65107]: INFO networking_nsxv3.common.synchronization [req-36b4324a-98d9-4073-9bdb-30f7c6351bec req-fd93ca74-2269-4741-9dc8-66941edc0210 service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1176.970206] env[65107]: INFO networking_nsxv3.common.synchronization [req-36b4324a-98d9-4073-9bdb-30f7c6351bec req-fd93ca74-2269-4741-9dc8-66941edc0210 service nova] Enqueued Resource ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 with Priority: HIGHEST for action port [ 1176.970636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.970977] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.971145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.971545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.971779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.972188] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.973928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.973928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.973928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.973928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.973928] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30172372-1775-4005-bb5c-5e216ae55211 is going to be created. [ 1176.974478] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 1176.974621] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1176.974768] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 with Priority: HIGHEST for action port [ 1176.975064] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.976028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.976028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.976028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.976028] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.976574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.976670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.976858] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.976961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.977035] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.977202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.978109] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a39c781-a4b2-4eeb-9ef9-21d14fde6206',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.034785] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.034996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.035129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.035330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.035431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.035536] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1177.043201] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.043367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.043520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.043732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.044036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.055527] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: IN_PROGRESS for 2s [ 1177.069439] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.069439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.069439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.069632] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.069708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.079671] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1177.479387] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 with status ACTIVE [ 1177.479636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.479778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.480099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.480099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.480287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.480424] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.480526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.480589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.480752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.480831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.481028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.481122] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.481218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.481354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.481429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.481514] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 is going to be updated. [ 1177.483175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.483366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.505718] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.505934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.506080] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.506349] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.506548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.506725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.645335] env[65107]: INFO networking_nsxv3.common.synchronization [req-c504c2da-e5d4-40f5-9717-279da7fe7626 req-14cbfde4-cb76-48fa-b190-da81d01a4927 tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_members [ 1177.645335] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_members [ 1177.645675] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b54cadd8-8b2d-427a-b017-3c0370790709 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.645929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.645929] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.646175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.646356] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.646500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.646533] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.646693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.646793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.646896] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.841274] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1177.841461] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d deletion is rescheduled due to dependency. [ 1177.841583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.841770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.842021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.842238] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.842438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.842520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.842751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.842820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.842912] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.976197] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.976470] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.976863] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.977335] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.977839] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.978173] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.978346] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.978721] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.978926] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.979222] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.979358] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.979472] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.980152] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.980152] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.980152] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.980152] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.002897] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.003266] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.003460] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.003665] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-322" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.003997] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-ee9db800-8d65-4513-8dbe-5b0083751456 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.004482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.004482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.004482] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.005335] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9db800-8d65-4513-8dbe-5b0083751456',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.151499] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.151698] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.151821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.151949] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.152066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.152277] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.152378] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.152441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.152608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.152685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.152771] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b54cadd8-8b2d-427a-b017-3c0370790709 already deleted. [ 1178.152851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.345847] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.508665] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.509039] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.509039] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.509321] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.509467] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.509649] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port ee9db800-8d65-4513-8dbe-5b0083751456 not found, creating... [ 1178.509984] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.510102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.510247] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.510463] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.510615] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.510936] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.512174] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.512371] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.512569] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.512730] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.512898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: ee9db800-8d65-4513-8dbe-5b0083751456 is going to be created. [ 1178.537886] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.538234] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.538368] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.538707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.542736] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.543098] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.850405] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.069243] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: SUCCESS [ 1179.069456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.093965] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1179.093965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.094185] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.094328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.094560] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.094700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.094854] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.095061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.095166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.095276] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.095330] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.257194] env[65107]: INFO networking_nsxv3.common.synchronization [req-c504c2da-e5d4-40f5-9717-279da7fe7626 req-dd25a306-9ca3-4929-98f3-9ccc58939f0e service nova] Enqueued Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_rules [ 1179.257320] env[65107]: INFO networking_nsxv3.common.synchronization [req-c504c2da-e5d4-40f5-9717-279da7fe7626 req-dd25a306-9ca3-4929-98f3-9ccc58939f0e service nova] Enqueued Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_members [ 1179.257479] env[65107]: INFO networking_nsxv3.common.synchronization [req-c504c2da-e5d4-40f5-9717-279da7fe7626 req-dd25a306-9ca3-4929-98f3-9ccc58939f0e service nova] Enqueued Resource ID: ee9db800-8d65-4513-8dbe-5b0083751456 with Priority: HIGHEST for action port [ 1179.258199] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_rules [ 1179.258885] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_members [ 1179.259018] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee9db800-8d65-4513-8dbe-5b0083751456 with Priority: HIGHEST for action port [ 1179.259373] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b54cadd8-8b2d-427a-b017-3c0370790709 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.259487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.259556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.259820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.259904] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.261210] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b54cadd8-8b2d-427a-b017-3c0370790709 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.261475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.261475] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.261705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.261863] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.261973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.262051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.262199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.262305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.262436] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.263436] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee9db800-8d65-4513-8dbe-5b0083751456 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.263600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.263678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.263846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.263963] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9db800-8d65-4513-8dbe-5b0083751456',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.353164] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.353278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.353403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.353692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.353831] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.353965] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1179.387388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.387636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.387813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.388137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.388317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.397811] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1179.598338] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.598528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.598606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.598866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.599061] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.599181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.599248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.599409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.599500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.599592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.599768] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.599866] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.599944] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.600084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.600249] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.600374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.600451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.600638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.600757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.601313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.601656] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.768061] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.768061] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b54cadd8-8b2d-427a-b017-3c0370790709 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.768302] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.768342] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee9db800-8d65-4513-8dbe-5b0083751456 with status ACTIVE [ 1179.768515] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.768598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.768706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.768848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.768938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.769149] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.769287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.769345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.769509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.769594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.769789] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.769885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.769928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.770079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.770142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.770226] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee9db800-8d65-4513-8dbe-5b0083751456 is going to be updated. [ 1179.792292] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.792456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.792520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.792752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.792918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.793114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee9db800-8d65-4513-8dbe-5b0083751456" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.104820] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c066e724-cbaf-469e-be19-001bda52a5c7: rpc.has_security_group_logging(os_id): False [ 1180.122189] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.122373] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.122418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.122840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.122840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.123016] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.123180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.123217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.123364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.123472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.123747] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.123747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.123874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.123956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.124042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.124226] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.124371] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.124407] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.124515] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.124583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.124665] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1180.189333] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.189525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.189525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.189741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.189902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.204229] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1180.272032] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.775582] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.775758] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.775886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.776601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.776601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.776601] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b54cadd8-8b2d-427a-b017-3c0370790709 is going to be created. [ 1180.812134] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.812376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.812376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.812570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.812812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.828119] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b54cadd8-8b2d-427a-b017-3c0370790709 in Status: UNINITIALIZED for 2s [ 1181.409853] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1181.410245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.410339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.410514] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.410738] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.410904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.410973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.411170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.411264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.411346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.411456] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.810293] env[65107]: INFO networking_nsxv3.common.synchronization [req-3fe5ff08-0da0-4ad2-8712-8bda29280e4f req-e455866e-d9d0-48a1-b870-a2f519ed9013 tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_members [ 1181.810942] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_members [ 1181.811330] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.811412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.811482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.811754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.811920] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.812036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.812134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.812305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.812400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.812500] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.913798] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.186355] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.186561] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.186740] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.187117] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.187437] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.187646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.187767] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.187982] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.188188] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.188426] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.188564] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.188693] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.188822] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.188936] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.189050] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.189202] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.208906] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.209188] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1182.209391] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.209602] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.209950] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-d52217e8-7680-49de-ab3a-ba04070909a7 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.210211] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.210367] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.210732] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.210913] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d52217e8-7680-49de-ab3a-ba04070909a7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.218950] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1182.219206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.272529] env[65107]: INFO networking_nsxv3.common.synchronization [req-b8b2321a-5dc5-4435-bbb4-ac60073694d1 req-d333d34f-0178-43fc-8918-96f1936ab9a1 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1182.273191] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1182.273510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.273961] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.275347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.275653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.276163] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.276163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.276163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.276595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.276732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.276858] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.314595] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.314811] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.314903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.315149] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.315248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.315450] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.315549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.315613] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.315790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.315861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.315920] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 already deleted. [ 1182.315997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.416878] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11705357-9323-4e1c-bf51-81c8b975ee5d: rpc.has_security_group_logging(os_id): False [ 1182.437328] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.437466] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.437466] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.437709] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.437784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.438761] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.438761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.438761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.438761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.438761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.438761] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1182.498708] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.498867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.498867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.499778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.499778] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.515343] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1182.713350] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.713647] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.713782] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.714202] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.714476] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.714922] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port d52217e8-7680-49de-ab3a-ba04070909a7 not found, creating... [ 1182.715240] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.715408] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.715542] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.715787] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.715955] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.716277] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.716436] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.716568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.716796] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.716929] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.717099] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: d52217e8-7680-49de-ab3a-ba04070909a7 is going to be created. [ 1182.737830] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.738101] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.738212] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.738438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.738716] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.738960] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.778813] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.841878] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b54cadd8-8b2d-427a-b017-3c0370790709 in Status: SUCCESS [ 1182.842075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.842154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.842421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.842640] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.842846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.842920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.843109] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.843267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.843341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.843425] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.280765] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.346797] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.489086] env[65107]: INFO networking_nsxv3.common.synchronization [req-3fe5ff08-0da0-4ad2-8712-8bda29280e4f req-4631ea0d-24e1-4d90-9a1d-5c3100208f7d service nova] Enqueued Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_rules [ 1183.489451] env[65107]: INFO networking_nsxv3.common.synchronization [req-3fe5ff08-0da0-4ad2-8712-8bda29280e4f req-4631ea0d-24e1-4d90-9a1d-5c3100208f7d service nova] Enqueued Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_members [ 1183.489664] env[65107]: INFO networking_nsxv3.common.synchronization [req-3fe5ff08-0da0-4ad2-8712-8bda29280e4f req-4631ea0d-24e1-4d90-9a1d-5c3100208f7d service nova] Enqueued Resource ID: d52217e8-7680-49de-ab3a-ba04070909a7 with Priority: HIGHEST for action port [ 1183.490282] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_rules [ 1183.490411] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_members [ 1183.490508] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52217e8-7680-49de-ab3a-ba04070909a7 with Priority: HIGHEST for action port [ 1183.491457] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.491585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.491681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.491954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.492098] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.493211] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.493351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.493351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.493660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.493727] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.493830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.493893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.494075] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.494165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.494260] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.495232] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-d52217e8-7680-49de-ab3a-ba04070909a7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.495232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.495333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.495447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.495504] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d52217e8-7680-49de-ab3a-ba04070909a7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.785522] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.785781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.785940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.786218] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.786358] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.786498] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1183.816400] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.816653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.816744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.817675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.817675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.826772] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1183.848220] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b54cadd8-8b2d-427a-b017-3c0370790709: rpc.has_security_group_logging(os_id): False [ 1183.867039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.867278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.867351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.867563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.867656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.867906] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.868017] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.868081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.868233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.868311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.868399] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b54cadd8-8b2d-427a-b017-3c0370790709 is going to be created. [ 1183.936979] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.937229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.937315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.937495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.937684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.950877] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b54cadd8-8b2d-427a-b017-3c0370790709 in Status: IN_PROGRESS for 2s [ 1183.997566] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.998867] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.999061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.999251] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d52217e8-7680-49de-ab3a-ba04070909a7 with status ACTIVE [ 1183.999465] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.999612] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.999706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.999956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.000097] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.000349] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.000499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.000601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.001159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.001159] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.001266] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.001420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.001523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.001756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.001891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.002055] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d52217e8-7680-49de-ab3a-ba04070909a7 is going to be updated. [ 1184.027649] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.027895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.027895] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.028094] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.028255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.028396] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d52217e8-7680-49de-ab3a-ba04070909a7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.504501] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.529179] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1184.529399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.007583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.007744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.007821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.008058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.008155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.008258] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 is going to be created. [ 1185.034232] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.034232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.034232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.034389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.034501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.046226] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 in Status: UNINITIALIZED for 2s [ 1185.839392] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1185.839762] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.964731] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b54cadd8-8b2d-427a-b017-3c0370790709 in Status: SUCCESS [ 1185.964908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.056716] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 in Status: SUCCESS [ 1187.057162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.057162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.057333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.057529] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.057645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.057707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.057860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.057941] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.058038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.058164] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.560454] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.761603] env[65107]: INFO networking_nsxv3.common.synchronization [req-3879cb54-ba6d-4021-ba95-81c29239d3cb req-a90fb0fa-badd-49c7-a2b1-9d5137a2c831 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1187.762284] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1187.763345] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.763345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.763345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.763345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.763645] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.763645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.763645] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.763799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.763869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.764019] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.063057] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5: rpc.has_security_group_logging(os_id): False [ 1188.083272] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.083511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.083511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.083690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.083781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.084036] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.084142] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.084205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.084356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.084432] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.084522] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 is going to be created. [ 1188.169314] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.169551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.169640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.169945] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.170226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.184286] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 in Status: IN_PROGRESS for 2s [ 1188.267177] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.267423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.267826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.267826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.268020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.268214] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.268351] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.268436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.268635] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.268766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.268856] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1188.313041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.313282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.313282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.313493] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.313640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.326325] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1190.198891] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 in Status: SUCCESS [ 1190.199148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.342681] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1190.342972] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1190.342972] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.056051] env[65107]: INFO networking_nsxv3.common.synchronization [req-beb65451-5262-42a0-a5e9-385b60e3d9be req-1dd878bb-bd0c-49f8-b769-e5e46012d62d tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1191.056167] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1191.056613] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.056773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.056827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.057170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.057354] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.057456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.057528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.057677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.057763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.057873] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.362457] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.362996] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.363280] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.363684] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.364088] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.364361] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.364563] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.364914] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.365148] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.365437] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.365555] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.365659] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.365792] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.365908] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.365967] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.366122] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.391723] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.392078] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.392302] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.392624] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.392997] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-a615c26e-a090-4963-b782-2954e6ffc8a6 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.393235] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.393436] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.393727] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.393891] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a615c26e-a090-4963-b782-2954e6ffc8a6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.559985] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.896734] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.896948] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.897128] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.897466] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.897624] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.897816] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port a615c26e-a090-4963-b782-2954e6ffc8a6 not found, creating... [ 1191.898175] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.898350] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.898468] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.898689] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.898827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.899115] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.899270] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.899382] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.899584] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.899715] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.899852] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: a615c26e-a090-4963-b782-2954e6ffc8a6 is going to be created. [ 1191.919927] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.920162] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.920265] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.920525] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.920759] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.920981] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.062283] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.565106] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.565476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.565476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.565544] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.565727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.565727] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1192.597262] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.597510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.597608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.597869] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.598117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.607853] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1192.624158] env[65107]: INFO networking_nsxv3.common.synchronization [req-beb65451-5262-42a0-a5e9-385b60e3d9be req-6832e5a7-2e92-4ea9-b3ac-e1aed0eb2fc4 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1192.624284] env[65107]: INFO networking_nsxv3.common.synchronization [req-beb65451-5262-42a0-a5e9-385b60e3d9be req-6832e5a7-2e92-4ea9-b3ac-e1aed0eb2fc4 service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1192.624437] env[65107]: INFO networking_nsxv3.common.synchronization [req-beb65451-5262-42a0-a5e9-385b60e3d9be req-6832e5a7-2e92-4ea9-b3ac-e1aed0eb2fc4 service nova] Enqueued Resource ID: a615c26e-a090-4963-b782-2954e6ffc8a6 with Priority: HIGHEST for action port [ 1192.625085] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1192.625136] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1192.625231] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a615c26e-a090-4963-b782-2954e6ffc8a6 with Priority: HIGHEST for action port [ 1192.625507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.625627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.625694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.625925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.626015] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.627305] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.627747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.627816] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a615c26e-a090-4963-b782-2954e6ffc8a6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.627879] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.627988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.628115] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.628184] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a615c26e-a090-4963-b782-2954e6ffc8a6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.128084] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.128084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.133423] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a615c26e-a090-4963-b782-2954e6ffc8a6 with status ACTIVE [ 1193.133423] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.133423] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.133423] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.133423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.133423] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a615c26e-a090-4963-b782-2954e6ffc8a6 is going to be updated. [ 1193.169648] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.172189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.172298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.172496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.172639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.172820] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a615c26e-a090-4963-b782-2954e6ffc8a6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.618687] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1194.619128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.619128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.619297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.619505] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.619619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.619684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.619839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.619924] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.620038] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.122996] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.627535] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.130606] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.130768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.130839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.131246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.131420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.131587] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1196.162104] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.162275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.162275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.162441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.162587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.171464] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1197.626522] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1197.626522] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1198.182330] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1198.182551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.182752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.183092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.183322] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.183452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.183549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.183733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.183832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.183939] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.184065] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.686797] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.687300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.687300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.687300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.687451] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.687536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.687744] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.687841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.687841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.688138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.688138] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.688357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.688357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.688496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.688719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.688808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.688856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.689029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.689139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.689247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.689342] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.788039] env[65107]: INFO networking_nsxv3.common.synchronization [req-d9781bdc-8a87-4645-8f70-1343a30afcec req-d057ba95-e5b3-4083-847e-8b5e6fd73787 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1198.788322] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1198.788543] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.788656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.788723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.788915] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.789081] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.789178] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.789232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.789381] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.789468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.789560] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.063831] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.064188] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.064363] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.064637] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.064895] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.065160] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.065319] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.065574] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.065763] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.066076] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.066237] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.066380] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.066518] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.066664] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.066797] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.066959] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.118116] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.118438] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.118623] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.118891] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-573" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.119273] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-440e3ed1-e2d5-4d0b-b58d-381035529ef7 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.119478] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.119621] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.119960] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.120158] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('440e3ed1-e2d5-4d0b-b58d-381035529ef7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.192102] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cacf6191-ed0d-498d-a524-904b8f81b797: rpc.has_security_group_logging(os_id): False [ 1199.210253] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.210440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.210520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.210686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.210768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.210967] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.211198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.211198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.211333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.211391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.211551] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.211653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.211718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.211829] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.211898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.212169] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.212298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.212380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.212545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.212610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.212898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1199.292070] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.292070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.292307] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.292484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.292611] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.292852] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.292992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.293049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.293203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.293279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.293369] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1199.295590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.295711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.295754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.295938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.296087] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.313554] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1199.324548] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.324726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.324771] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.325025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.325177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.334224] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1199.624066] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.624066] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.624066] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.624066] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.624066] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.624393] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 440e3ed1-e2d5-4d0b-b58d-381035529ef7 not found, creating... [ 1199.624483] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.624626] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.624734] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.624971] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.625133] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.625415] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.625568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.625682] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.625880] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.626052] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.626192] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 440e3ed1-e2d5-4d0b-b58d-381035529ef7 is going to be created. [ 1199.645527] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.645752] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.645820] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.646143] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.646372] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.646595] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.323921] env[65107]: INFO networking_nsxv3.common.synchronization [req-d9781bdc-8a87-4645-8f70-1343a30afcec req-6e3a7092-5dca-445d-ba09-7005180d2a1d service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1200.324262] env[65107]: INFO networking_nsxv3.common.synchronization [req-d9781bdc-8a87-4645-8f70-1343a30afcec req-6e3a7092-5dca-445d-ba09-7005180d2a1d service nova] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1200.324262] env[65107]: INFO networking_nsxv3.common.synchronization [req-d9781bdc-8a87-4645-8f70-1343a30afcec req-6e3a7092-5dca-445d-ba09-7005180d2a1d service nova] Enqueued Resource ID: 440e3ed1-e2d5-4d0b-b58d-381035529ef7 with Priority: HIGHEST for action port [ 1200.324987] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_rules [ 1200.324987] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1200.325127] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3ed1-e2d5-4d0b-b58d-381035529ef7 with Priority: HIGHEST for action port [ 1200.325357] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.325489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.325527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.325730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.325826] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.326681] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.326873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.327892] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-440e3ed1-e2d5-4d0b-b58d-381035529ef7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.328051] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.328125] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.328277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.328370] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('440e3ed1-e2d5-4d0b-b58d-381035529ef7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.830641] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.830818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.830982] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 440e3ed1-e2d5-4d0b-b58d-381035529ef7 with status ACTIVE [ 1200.831176] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.831286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.831352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.831573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.831664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.831832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.831926] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.831986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.832155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.832241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.832407] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.832490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.832549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.832713] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.832769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.832827] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 440e3ed1-e2d5-4d0b-b58d-381035529ef7 is going to be updated. [ 1200.856049] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.856049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.856049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.856049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.856049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.856399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-440e3ed1-e2d5-4d0b-b58d-381035529ef7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.160676] env[65107]: INFO networking_nsxv3.common.synchronization [req-390fd415-6184-4c15-afb3-68aa168e5bc0 req-1b0e0fd9-71a2-4719-ad46-c99af05eca09 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1201.161262] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1201.161562] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.161695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.161745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.161934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.162107] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.162208] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.162268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.162453] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.162540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.162637] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.330465] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1201.330465] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.351164] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1201.351520] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1201.351722] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.351996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.352341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.352595] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.352763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.352892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.353248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.353248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.353384] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.464168] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.464447] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.464679] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.465125] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.465540] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.465801] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.466063] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.466410] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.466642] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.466979] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.467187] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.467369] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.467543] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.467731] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.467904] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.468133] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.489492] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.489721] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1201.489916] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.490185] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-436" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.490627] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-1b75ff0a-5c25-44c0-b735-a58ce2eece42 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.490860] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.491054] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.491571] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.491771] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b75ff0a-5c25-44c0-b735-a58ce2eece42',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.666516] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.857039] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.994527] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.994814] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.995016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.995372] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.995549] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.995769] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 1b75ff0a-5c25-44c0-b735-a58ce2eece42 not found, creating... [ 1201.996073] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.996292] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.996421] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.996646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.996780] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.997131] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.997338] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.997485] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.997717] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.997885] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.998066] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 1b75ff0a-5c25-44c0-b735-a58ce2eece42 is going to be created. [ 1202.020670] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.020900] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.021034] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.021341] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.021574] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.021861] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.169751] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.359568] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.672710] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.673091] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.673198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.673536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.673730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.673904] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be is going to be updated. [ 1202.694294] env[65107]: INFO networking_nsxv3.common.synchronization [req-40d42723-32f8-4c28-82ee-f574766eb615 req-243cc28f-de87-4e93-8939-da36e54aaf55 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1202.694644] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1202.695017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.695162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.695224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.695423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.695575] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.695670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.695730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.695867] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.695979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.696078] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.701156] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.701280] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.701346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.701519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.701664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.712695] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: IN_PROGRESS for 2s [ 1202.730986] env[65107]: INFO networking_nsxv3.common.synchronization [req-390fd415-6184-4c15-afb3-68aa168e5bc0 req-b536a112-0f06-42cf-9110-599f127e205f service nova] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 1202.731187] env[65107]: INFO networking_nsxv3.common.synchronization [req-390fd415-6184-4c15-afb3-68aa168e5bc0 req-b536a112-0f06-42cf-9110-599f127e205f service nova] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1202.731324] env[65107]: INFO networking_nsxv3.common.synchronization [req-390fd415-6184-4c15-afb3-68aa168e5bc0 req-b536a112-0f06-42cf-9110-599f127e205f service nova] Enqueued Resource ID: 1b75ff0a-5c25-44c0-b735-a58ce2eece42 with Priority: HIGHEST for action port [ 1202.731801] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_rules [ 1202.731981] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1202.732110] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b75ff0a-5c25-44c0-b735-a58ce2eece42 with Priority: HIGHEST for action port [ 1202.732431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.732554] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.732620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.732839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.732938] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.734878] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.734878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.734878] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b75ff0a-5c25-44c0-b735-a58ce2eece42 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.735161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.735161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.735277] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.735777] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b75ff0a-5c25-44c0-b735-a58ce2eece42',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.862422] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.862610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.862650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.863093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.863093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.863093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1202.907169] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.907169] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.907891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.907891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.909267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.923339] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1203.199509] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.234789] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.234978] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.237173] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b75ff0a-5c25-44c0-b735-a58ce2eece42 with status ACTIVE [ 1203.237483] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.237617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.237685] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.237904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.237993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.238191] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.238289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.238416] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.238518] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.238595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.238770] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.238860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.238921] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.239060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.239137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.239218] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b75ff0a-5c25-44c0-b735-a58ce2eece42 is going to be updated. [ 1203.259468] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.259637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.259676] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.259842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.259970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.260141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b75ff0a-5c25-44c0-b735-a58ce2eece42" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.701430] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.203941] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.204139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.204228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.204467] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.204562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.204669] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1204.234326] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.234326] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.234605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.234693] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.234920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.244220] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1204.723657] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: SUCCESS [ 1204.724037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.724213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.724452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.724655] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.724790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.724856] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.725061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.725151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.725251] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.934414] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1204.934643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.934841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.935089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.935395] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.935395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.935527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.935592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.935669] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.935750] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.935839] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.228462] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.418837] env[65107]: INFO networking_nsxv3.common.synchronization [req-e31bdfcd-60c7-4cf5-b945-97cf11c7cfed req-ac3d6005-7cbc-46c4-bc16-40dce33458f7 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_members [ 1205.419463] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGHEST for action security_group_members [ 1205.419788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.419917] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.419985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.420212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.420370] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.420468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.420783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.420783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.420783] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.420958] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.438131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.438339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.438339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.438556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.438913] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.438913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.438913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.438913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.439287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.439287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.439371] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.439451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.439503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.439637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.439775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.439862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.439918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.440089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.440166] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.440252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.440340] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.731411] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.924381] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.924586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.924586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.924787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.924912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.925553] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.925553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.925553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.925553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.925805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.925805] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 is going to be updated. [ 1205.942162] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c066e724-cbaf-469e-be19-001bda52a5c7: rpc.has_security_group_logging(os_id): False [ 1205.958171] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.958388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.958444] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.958624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.958768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.960574] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.960696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.960766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.960940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.961039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.961222] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.961321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.961374] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.961521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.961599] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.961852] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.961958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.962031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.962174] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.962250] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.962429] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.962521] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.962576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.962712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.962785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.962867] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1205.973740] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 in Status: IN_PROGRESS for 2s [ 1206.031165] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.031354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.031354] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.031522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.031651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.047546] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1206.234281] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.234694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.234694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.235045] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.235163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.235287] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be is going to be updated. [ 1206.256025] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 4s [ 1206.271575] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.271858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.271980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.272473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.272473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.282927] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: IN_PROGRESS for 2s [ 1207.984230] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 in Status: SUCCESS [ 1207.984573] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 deletion is rescheduled due to dependency. [ 1207.984573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.061753] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1208.062073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.266129] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1208.266383] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.292225] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: SUCCESS [ 1208.292447] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.292619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.292860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.293087] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.293241] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.293317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.293419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.293501] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.293589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.293682] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.795924] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.298207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d4a7699-28a9-417a-9e0b-bf15ce0027be: rpc.has_security_group_logging(os_id): False [ 1209.316511] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.316699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.316699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.316855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.337100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.337524] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.337661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.337731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.337956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.338084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.338177] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be is going to be updated. [ 1209.401944] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.402170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.402170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.402390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.402535] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.416274] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: IN_PROGRESS for 2s [ 1210.420980] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.421324] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1211.431830] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: SUCCESS [ 1211.432289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.089968] env[65107]: INFO networking_nsxv3.common.synchronization [req-8aa5b3a6-bfe9-436f-a904-ca5ab82d7d25 req-50c471d1-348b-40d5-82b8-ec33b80039bc tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1212.091156] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1212.091156] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.091353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.091353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.091571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.091782] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.091919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.092025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.092433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.092433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.092576] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.361068] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.361309] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.361429] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.361733] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.361995] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.362336] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.362525] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.362677] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.362825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.363055] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.363200] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.363327] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.363438] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.363547] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.363651] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.363780] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.384244] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.384433] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.384551] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.384735] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-202" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.385113] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-815d94ff-8dc7-481e-8fcd-ee55f5195395 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.385316] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.385438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.385760] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.385899] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815d94ff-8dc7-481e-8fcd-ee55f5195395',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.595928] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.889767] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.890009] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.890146] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.890442] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.890591] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.890742] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 815d94ff-8dc7-481e-8fcd-ee55f5195395 not found, creating... [ 1212.891014] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.891177] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.891293] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.891512] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.891646] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.891921] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.892097] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.892217] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.892423] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.892556] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.892691] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 815d94ff-8dc7-481e-8fcd-ee55f5195395 is going to be created. [ 1212.963037] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.963037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.963037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.963037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.963037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.963037] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.098713] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.601388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.601770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.601770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.601848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.601905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.602040] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1213.640039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.640039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.640039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.640039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.640039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.642055] env[65107]: INFO networking_nsxv3.common.synchronization [req-8aa5b3a6-bfe9-436f-a904-ca5ab82d7d25 req-7da90299-0ee8-40fb-9cc6-44025e73512e service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1213.642378] env[65107]: INFO networking_nsxv3.common.synchronization [req-8aa5b3a6-bfe9-436f-a904-ca5ab82d7d25 req-7da90299-0ee8-40fb-9cc6-44025e73512e service nova] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1213.642810] env[65107]: INFO networking_nsxv3.common.synchronization [req-8aa5b3a6-bfe9-436f-a904-ca5ab82d7d25 req-7da90299-0ee8-40fb-9cc6-44025e73512e service nova] Enqueued Resource ID: 815d94ff-8dc7-481e-8fcd-ee55f5195395 with Priority: HIGHEST for action port [ 1213.643537] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_rules [ 1213.643798] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1213.644013] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815d94ff-8dc7-481e-8fcd-ee55f5195395 with Priority: HIGHEST for action port [ 1213.645581] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.645581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.645581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.645581] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.645581] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.646660] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.646660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.646660] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-815d94ff-8dc7-481e-8fcd-ee55f5195395 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.646919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.648549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.648549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.648549] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815d94ff-8dc7-481e-8fcd-ee55f5195395',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.651070] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1214.149536] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.149730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.152286] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 815d94ff-8dc7-481e-8fcd-ee55f5195395 with status ACTIVE [ 1214.152503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.152626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.152705] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.153013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.153162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.153388] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.153543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.153619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.153855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.153996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.154171] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.154310] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.154375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.154528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.154640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.154732] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 815d94ff-8dc7-481e-8fcd-ee55f5195395 is going to be updated. [ 1214.177265] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.177470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.177571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.177861] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.178078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.178322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-815d94ff-8dc7-481e-8fcd-ee55f5195395" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.663149] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1215.663678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.663678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.663828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.663993] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.664123] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.664189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.664331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.664422] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.664496] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.167214] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.670626] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.173438] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.173601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.173672] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.173900] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.173990] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.174109] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1217.203935] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.204181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.204231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.204412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.204556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.216324] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1218.645564] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1218.646028] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1219.231814] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.231814] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.231814] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.231814] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.734981] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.735534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.735534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.735793] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.736113] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.736264] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.736370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.736656] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.736806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.736956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.737229] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.737458] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.737592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.737807] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.737971] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.738129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.738200] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.738387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.738498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.738639] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.738739] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.241701] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cacf6191-ed0d-498d-a524-904b8f81b797: rpc.has_security_group_logging(os_id): False [ 1220.262971] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.263193] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.263248] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.263474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.263573] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.263775] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.263905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.263970] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.264088] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.264158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.264358] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.264456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.264513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.264647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.264756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.265016] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.265150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.265217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.265352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.265423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.265508] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1220.375341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.375341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.375341] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.375524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.375524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.395541] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1222.415370] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1222.415715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.646603] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.647131] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1226.927608] env[65107]: INFO networking_nsxv3.common.synchronization [req-be9f7c5c-06c1-494c-965d-a2529898ef5d req-f35a28f9-d713-4925-ac36-3765d9d57d4b tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1226.927853] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1226.928192] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.928318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.928386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.928586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.928739] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.928837] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.928894] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.929334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.929334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.929334] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.435070] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.937464] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.440794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.440956] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.441044] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.441279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.441380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.441487] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1228.474942] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.475121] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.475165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.475409] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.475586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.485342] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1230.497104] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1230.497489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.929170] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1231.929515] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1234.080356] env[65107]: INFO networking_nsxv3.common.synchronization [req-d112d677-2cf1-4fff-8847-70952843e408 req-0e5a13cd-5ab7-436c-a310-c8097c0afd38 tempest-ServersTestJSON-1168777638 tempest-ServersTestJSON-1168777638-project-member] Enqueued Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1234.080356] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacf6191-ed0d-498d-a524-904b8f81b797 with Priority: HIGHEST for action security_group_members [ 1234.080861] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cacf6191-ed0d-498d-a524-904b8f81b797 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.081134] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.081405] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.081816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.082074] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.082257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.082367] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.082590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.082704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.082834] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cacf6191-ed0d-498d-a524-904b8f81b797',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.589987] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.590234] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.590309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.590607] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.590769] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.591043] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.591181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.591273] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.591481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.591623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.591744] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 is going to be updated. [ 1234.628688] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.628840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.628908] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.629147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.629299] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.646983] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: IN_PROGRESS for 2s [ 1236.674436] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cacf6191-ed0d-498d-a524-904b8f81b797 in Status: SUCCESS [ 1236.675177] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cacf6191-ed0d-498d-a524-904b8f81b797 deletion is rescheduled due to dependency. [ 1236.675537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cacf6191-ed0d-498d-a524-904b8f81b797" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.082369] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.082369] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.343433] env[65107]: INFO networking_nsxv3.common.synchronization [req-7fc2ae04-143b-4e99-9fe4-f6b6b68455dc req-7ec16f15-3044-46f1-8b0a-d56ea07b8710 tempest-DeleteServersTestJSON-910791755 tempest-DeleteServersTestJSON-910791755-project-member] Enqueued Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1240.343433] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c066e724-cbaf-469e-be19-001bda52a5c7 with Priority: HIGHEST for action security_group_members [ 1240.343433] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-c066e724-cbaf-469e-be19-001bda52a5c7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.343433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.343433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.345105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.345385] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.345534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.345590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.345805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.345891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.346015] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c066e724-cbaf-469e-be19-001bda52a5c7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.850366] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.850576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.850576] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.850810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.850899] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.851120] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.851214] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.851274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.851433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.851505] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.851590] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 is going to be updated. [ 1240.884723] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.884922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.884922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.885593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.885593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.896519] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: IN_PROGRESS for 2s [ 1241.405904] env[65107]: INFO networking_nsxv3.common.synchronization [req-6604cbf5-6e9e-46fd-bea1-71fea70fc9d8 req-d553b5e0-e555-4419-ac0c-06e2c5cd7f16 tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_members [ 1241.406823] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGHEST for action security_group_members [ 1241.406962] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.408039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.408039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.408039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.408039] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.408039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.408039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.408334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.408334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.408334] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.911075] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.911433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.911570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.912021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.912313] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.912800] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.913018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.913253] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.913570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.913712] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.913863] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 is going to be updated. [ 1241.957636] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.957904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.957904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.958217] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.958418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.969290] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 in Status: IN_PROGRESS for 2s [ 1242.908218] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c066e724-cbaf-469e-be19-001bda52a5c7 in Status: SUCCESS [ 1242.908594] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c066e724-cbaf-469e-be19-001bda52a5c7 deletion is rescheduled due to dependency. [ 1242.908638] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c066e724-cbaf-469e-be19-001bda52a5c7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.949333] env[65107]: INFO networking_nsxv3.common.synchronization [req-61af4c27-6bf6-45c1-85e9-ba1f100ccea2 req-c900bebf-489b-46f2-8d8d-ec0841466319 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1243.949333] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1243.949333] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.949333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.949333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.949818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.949818] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.949818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.949818] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.951061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.951061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.951061] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.979904] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 in Status: SUCCESS [ 1243.980103] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 deletion is rescheduled due to dependency. [ 1243.980245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.453455] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.453637] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.453730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.454194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.454194] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.454373] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.454479] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.454543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.454725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.454808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.454899] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1244.490564] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.490564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.490564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.490564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.490564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.504366] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1246.516511] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1246.516878] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f deletion is rescheduled due to dependency. [ 1246.516878] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.998140] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1247.998570] env[65107]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8c10b532-6ef8-4dfa-af79-6edee121e6ac None None] NSXv3 Agent Agent loop - iteration:3 started [ 1248.949851] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.949851] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1250.947135] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.947500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.947500] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.947651] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.947826] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.440085] env[65107]: INFO networking_nsxv3.common.synchronization [req-26ef3387-83c7-485b-a07a-b58aeab0c959 req-e7d0af7f-f9a6-4d5d-957d-110485a0b922 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1251.440797] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1251.441164] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.441298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.441562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.441628] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.441770] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.441890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.441950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.442114] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.442204] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.442301] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.450346] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.861213] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.861509] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.861692] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.862020] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.862441] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.862666] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.862829] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.863227] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.863465] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.863752] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.863922] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.864113] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.864287] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.864498] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.865348] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.865348] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.889136] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.889326] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.889462] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.889695] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.890325] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-197d658a-0227-4b78-a41c-5cb432b50721 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.890325] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.890325] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.890679] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.890821] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('197d658a-0227-4b78-a41c-5cb432b50721',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.946503] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.946695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.946780] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.946993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.947729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.947729] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.947729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.947729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.947729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.947729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.948316] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1251.952140] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.975397] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.975600] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.975654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.975855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.975994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.985507] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1252.393068] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.393837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.393837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.393837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.394018] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.394018] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 197d658a-0227-4b78-a41c-5cb432b50721 not found, creating... [ 1252.394871] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.394871] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.394871] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.394871] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.395115] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.395238] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.395328] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.395507] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.395738] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.395873] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.396015] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 197d658a-0227-4b78-a41c-5cb432b50721 is going to be created. [ 1252.419123] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.419590] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.419590] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.419872] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.422470] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.422470] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.454484] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1252.454661] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1252.846254] env[65107]: INFO networking_nsxv3.common.synchronization [None req-6880f91c-8713-40da-9577-8fbbb4746a96 None None] Enqueued Resource ID: a18da329-e94a-4617-adca-8e05b16c8b79 with Priority: HIGHEST for action port [ 1252.846818] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18da329-e94a-4617-adca-8e05b16c8b79 with Priority: HIGHEST for action port [ 1252.847167] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-a18da329-e94a-4617-adca-8e05b16c8b79 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.847340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a18da329-e94a-4617-adca-8e05b16c8b79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.847340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a18da329-e94a-4617-adca-8e05b16c8b79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.847572] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a18da329-e94a-4617-adca-8e05b16c8b79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.847655] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18da329-e94a-4617-adca-8e05b16c8b79',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.129572] env[65107]: INFO networking_nsxv3.common.synchronization [req-26ef3387-83c7-485b-a07a-b58aeab0c959 req-fc96d0b8-994a-48b5-a3cd-89e0f2818b2f service nova] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 1253.129969] env[65107]: INFO networking_nsxv3.common.synchronization [req-26ef3387-83c7-485b-a07a-b58aeab0c959 req-fc96d0b8-994a-48b5-a3cd-89e0f2818b2f service nova] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1253.129969] env[65107]: INFO networking_nsxv3.common.synchronization [req-26ef3387-83c7-485b-a07a-b58aeab0c959 req-fc96d0b8-994a-48b5-a3cd-89e0f2818b2f service nova] Enqueued Resource ID: 197d658a-0227-4b78-a41c-5cb432b50721 with Priority: HIGHEST for action port [ 1253.130406] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 1253.130541] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1253.130640] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 197d658a-0227-4b78-a41c-5cb432b50721 with Priority: HIGHEST for action port [ 1253.130927] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.131249] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.131368] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.131605] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.131720] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.132789] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.133995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.134363] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-197d658a-0227-4b78-a41c-5cb432b50721 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.134539] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.134655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.134882] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.135013] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('197d658a-0227-4b78-a41c-5cb432b50721',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.353027] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a18da329-e94a-4617-adca-8e05b16c8b79 [ 1253.353027] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.353027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.353027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.353027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.353027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.353027] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a18da329-e94a-4617-adca-8e05b16c8b79 already deleted. [ 1253.353027] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a18da329-e94a-4617-adca-8e05b16c8b79" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.508490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.508490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.508490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.508490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.523019] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1253.523519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.524654] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1253.567724] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.569519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.569519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.569751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.592020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.592020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1253.592020] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1253.592020] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1253.637362] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.637626] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.637673] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 197d658a-0227-4b78-a41c-5cb432b50721 with status ACTIVE [ 1253.637907] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.638247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.638247] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.638399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.638399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.638540] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.638627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.638682] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.638873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.638958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.639517] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.639517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.639517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.639517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.639517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.640069] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 197d658a-0227-4b78-a41c-5cb432b50721 is going to be updated. [ 1253.644133] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.644133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.644352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.644399] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.645874] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.646243] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1253.670597] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.670877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.671796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.671796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.671796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.671796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-197d658a-0227-4b78-a41c-5cb432b50721" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.747659] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.747897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.747897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.748260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.748481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.748720] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1253.883624] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.883784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.883784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.883992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.884336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.884638] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1253.884737] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6970c294-30ba-4814-9be8-ff7a47ecd5e8', '4b4c1c41-3e51-4f2c-b0f0-da054bcade26', 'a3f12117-47c0-49e5-a9ee-6998ac5d5281', '14ef83a8-ad90-4c5e-987a-1f28536fa472', 'cfc0215e-9e19-4ef1-8f09-6aafac54a47f', 'a2cc3c5b-5d64-430b-ba1a-61805cb1246f', '30172372-1775-4005-bb5c-5e216ae55211', '65db01b4-9be5-4612-9e1c-a336eb7f22d1', '5166db24-d7b9-43dd-8152-fa49fdb2e750', 'cb36a1e8-ba8d-491f-8291-18b58f2dfd6e', 'b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5', '0b0e1e5d-6b69-4241-b187-86836e4d9086', 'c78203ee-b32f-401b-9764-682ada8423c6', '2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083', 'f472a668-4442-488d-936d-2a700ed0a421', 'ae409816-e898-46fe-b06e-b955dd9008ef', '9125373b-7375-4872-9f2e-c95f9102b178', 'ed87eef5-439b-4752-b6cf-ead13a28e49a', 'c79582fb-f77d-4ad5-82e7-7e6d22e686de', '84f1e2df-169e-4c48-af3a-0f40af269363', 'fcf6500c-0f04-40de-ab53-f85da7100112', '8d4a7699-28a9-417a-9e0b-bf15ce0027be', '9be39cfe-e706-4bf7-8816-70542b5cb472', '3345c120-b2a0-4bae-bdda-4a9ccf7f6bc8', '4197bdde-e214-41a5-8235-df774396919e', 'c066e724-cbaf-469e-be19-001bda52a5c7', '24eb74d4-e639-4e5a-b7df-49fe504362b3', 'eddc4b52-aa90-46fd-ba26-8d960baeb169', 'cacf6191-ed0d-498d-a524-904b8f81b797', 'd43e6dbc-45c8-476b-af04-082906b1ad4d', 'e382ab2d-f671-4098-ac12-6a8786603007', '3e3c6061-32c5-4c10-8da4-b1be3cb71a03', '560f9d77-f914-4f8b-bc22-1688e970b817', 'b72cb83d-eebb-4f22-9614-47f9c3d37d79', '11705357-9323-4e1c-bf51-81c8b975ee5d', 'b54cadd8-8b2d-427a-b017-3c0370790709', 'b2882833-81aa-4338-b54e-9f9cd3047983', 'bd72c5b5-c134-476a-a735-5cb55328bc65', '8ff45994-1b33-49a8-9e8d-d4e639f2b297', '65c1ee26-a734-444a-b046-00bdd1cd350d', '814a62b8-5b9a-4a8b-96c6-18956744a0ed', 'a5c10011-beb4-47e7-8405-2bfc31ee7de0'} {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1253.884827] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1253.906278] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.906440] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.906486] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.906707] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.906797] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.906907] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1253.906981] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1253.907074] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1254.005245] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.005415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.005472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.005716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.006964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.007188] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1254.007269] env[65107]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65107) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1254.007372] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1254.007411] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1254.007533] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1254.007570] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGH for action security_group_rules [ 1254.007634] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGH for action security_group_rules [ 1254.007695] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGH for action security_group_rules [ 1254.007757] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGH for action security_group_rules [ 1254.007834] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGH for action security_group_rules [ 1254.007879] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGH for action security_group_rules [ 1254.007931] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGH for action security_group_rules [ 1254.007994] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGH for action security_group_rules [ 1254.008065] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGH for action security_group_rules [ 1254.008127] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGH for action security_group_rules [ 1254.008187] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGH for action security_group_rules [ 1254.008247] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGH for action security_group_rules [ 1254.008309] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGH for action security_group_rules [ 1254.008370] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGH for action security_group_rules [ 1254.008432] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGH for action security_group_rules [ 1254.008493] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGH for action security_group_rules [ 1254.008556] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGH for action security_group_rules [ 1254.008617] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGH for action security_group_rules [ 1254.008678] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGH for action security_group_rules [ 1254.008740] env[65107]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGH for action security_group_rules [ 1254.008836] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.009803] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1254.010155] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f deletion is rescheduled due to dependency. [ 1254.010155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.010233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.010410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.010577] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.010690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.010753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.010906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.010985] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.011168] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.517422] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.742020] env[65107]: INFO networking_nsxv3.common.synchronization [req-64c2e74a-107b-49a4-b8a2-c0efe996bf24 req-4e00a68d-0e7d-4762-b15e-00d1d3625034 tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_members [ 1254.742020] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 with Priority: HIGHEST for action security_group_members [ 1254.742020] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 with Priority: HIGH for action security_group_rules [ 1254.742020] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 with Priority: HIGH for action security_group_rules [ 1254.742707] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGH for action security_group_rules [ 1254.742947] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f472a668-4442-488d-936d-2a700ed0a421 with Priority: HIGH for action security_group_rules [ 1254.743176] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1e2df-169e-4c48-af3a-0f40af269363 with Priority: HIGH for action security_group_rules [ 1254.743399] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de with Priority: HIGH for action security_group_rules [ 1254.743589] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed87eef5-439b-4752-b6cf-ead13a28e49a with Priority: HIGH for action security_group_rules [ 1254.743870] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9125373b-7375-4872-9f2e-c95f9102b178 with Priority: HIGH for action security_group_rules [ 1254.744090] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 with Priority: HIGH for action security_group_rules [ 1254.744366] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae409816-e898-46fe-b06e-b955dd9008ef with Priority: HIGH for action security_group_rules [ 1254.744564] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78203ee-b32f-401b-9764-682ada8423c6 with Priority: HIGH for action security_group_rules [ 1254.744745] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 with Priority: HIGH for action security_group_rules [ 1254.744920] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 with Priority: HIGH for action security_group_rules [ 1254.745136] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e with Priority: HIGH for action security_group_rules [ 1254.745318] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 with Priority: HIGH for action security_group_rules [ 1254.745510] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f with Priority: HIGH for action security_group_rules [ 1254.745708] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 with Priority: HIGH for action security_group_rules [ 1254.745886] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGH for action security_group_rules [ 1254.746074] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 with Priority: HIGH for action security_group_rules [ 1254.746274] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 with Priority: HIGH for action security_group_rules [ 1254.746724] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-eddc4b52-aa90-46fd-ba26-8d960baeb169 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.747047] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.747206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.747509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.747758] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.747986] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.748145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.751018] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eddc4b52-aa90-46fd-ba26-8d960baeb169',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.751018] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.751018] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6970c294-30ba-4814-9be8-ff7a47ecd5e8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.751018] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.751018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.751555] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3f12117-47c0-49e5-a9ee-6998ac5d5281',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.752544] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.752788] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.752994] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.753245] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.753413] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.754361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f472a668-4442-488d-936d-2a700ed0a421 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.754653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.754806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.755049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.755224] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f472a668-4442-488d-936d-2a700ed0a421',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.759726] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1e2df-169e-4c48-af3a-0f40af269363 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.759726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.759726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.759726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.759726] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1e2df-169e-4c48-af3a-0f40af269363',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.759726] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.759726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.759726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.759726] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.759726] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c79582fb-f77d-4ad5-82e7-7e6d22e686de',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.760197] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed87eef5-439b-4752-b6cf-ead13a28e49a taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.760477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.760631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.761031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.761183] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed87eef5-439b-4752-b6cf-ead13a28e49a',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.762561] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9125373b-7375-4872-9f2e-c95f9102b178 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.762794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.762957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.763212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.763405] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9125373b-7375-4872-9f2e-c95f9102b178',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.764333] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.764653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.764816] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.765061] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.765220] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.766215] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae409816-e898-46fe-b06e-b955dd9008ef taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.766441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.766595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.766839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.767215] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae409816-e898-46fe-b06e-b955dd9008ef',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.767895] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c78203ee-b32f-401b-9764-682ada8423c6 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.768563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.768563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.768563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.769016] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c78203ee-b32f-401b-9764-682ada8423c6',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.769689] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0e1e5d-6b69-4241-b187-86836e4d9086 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.773022] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0e1e5d-6b69-4241-b187-86836e4d9086',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.773022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.773022] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.773022] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.773022] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.773022] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb36a1e8-ba8d-491f-8291-18b58f2dfd6e',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.774158] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5166db24-d7b9-43dd-8152-fa49fdb2e750 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.774394] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.774631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.774951] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.775129] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5166db24-d7b9-43dd-8152-fa49fdb2e750',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.776227] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.776459] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.776738] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.776982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.777165] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cc3c5b-5d64-430b-ba1a-61805cb1246f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.778032] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.778260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.778415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.778652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.778884] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65db01b4-9be5-4612-9e1c-a336eb7f22d1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.779672] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.779903] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.780215] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.780417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.780557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.780799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.780961] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4c1c41-3e51-4f2c-b0f0-da054bcade26',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.781701] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ef83a8-ad90-4c5e-987a-1f28536fa472 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.781935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.782103] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.782393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.786020] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ef83a8-ad90-4c5e-987a-1f28536fa472',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.022839] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.295823] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.295823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.295823] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.295980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.354390] env[65107]: INFO networking_nsxv3.common.synchronization [None req-5680f556-a566-4630-8290-f3f70c06e1e4 None None] Enqueued Resource ID: 1d3366bd-0491-4031-94f9-5a7f8b05f2c8 with Priority: HIGHEST for action port [ 1255.356774] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3366bd-0491-4031-94f9-5a7f8b05f2c8 with Priority: HIGHEST for action port [ 1255.357524] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d3366bd-0491-4031-94f9-5a7f8b05f2c8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.357524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d3366bd-0491-4031-94f9-5a7f8b05f2c8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.357524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d3366bd-0491-4031-94f9-5a7f8b05f2c8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.357714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d3366bd-0491-4031-94f9-5a7f8b05f2c8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.357714] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d3366bd-0491-4031-94f9-5a7f8b05f2c8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.380901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.380901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.380901] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.380901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.381796] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.381796] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.382347] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.382540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.384763] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.384763] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.389028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.389028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.389028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.389028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.389028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.389028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.389028] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.389028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.390253] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.390348] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.391978] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.393017] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.393138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.398367] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.398885] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.399037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.399309] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.399762] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.399870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.401024] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.401872] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.401872] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.402637] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.402637] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.402839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.403794] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.403966] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.404039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.404876] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.405871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.405871] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.405871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.405871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.406130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.406130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.406130] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 is going to be updated. [ 1255.407689] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.407791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.407844] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.408893] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.409487] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.409570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.410827] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.410827] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.410827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.433570] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1255.434499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.434748] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9125373b-7375-4872-9f2e-c95f9102b178 is going to be deleted. [ 1255.435918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.437282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.450325] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.450536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.450536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.450860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.451055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.460563] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.460761] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb36a1e8-ba8d-491f-8291-18b58f2dfd6e is going to be deleted. [ 1255.461661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.461871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.463419] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 in Status: IN_PROGRESS for 2s [ 1255.525834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.526228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.526228] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.526308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.526395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.526507] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1255.578158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.578158] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0e1e5d-6b69-4241-b187-86836e4d9086 is going to be deleted. [ 1255.578862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.579090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.623437] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.623437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.629089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.629209] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed87eef5-439b-4752-b6cf-ead13a28e49a is going to be deleted. [ 1255.630105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.630317] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.632484] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.632620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.632666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.632848] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.632984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.655045] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1255.660618] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.660618] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.667151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.667280] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae409816-e898-46fe-b06e-b955dd9008ef is going to be deleted. [ 1255.668230] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.668431] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.669831] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.669943] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.698222] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.698346] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5166db24-d7b9-43dd-8152-fa49fdb2e750 is going to be deleted. [ 1255.699328] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.700306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.723805] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.723805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.765487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.765696] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4c1c41-3e51-4f2c-b0f0-da054bcade26 is going to be deleted. [ 1255.766642] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.766857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.788842] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.788842] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.817773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.817947] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c78203ee-b32f-401b-9764-682ada8423c6 is going to be deleted. [ 1255.818887] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.819129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.860326] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d3366bd-0491-4031-94f9-5a7f8b05f2c8 [ 1255.860583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.860719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.860787] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.861013] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.861108] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.861205] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d3366bd-0491-4031-94f9-5a7f8b05f2c8 already deleted. [ 1255.861291] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d3366bd-0491-4031-94f9-5a7f8b05f2c8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.864782] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.864957] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.877736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.877903] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ef83a8-ad90-4c5e-987a-1f28536fa472 is going to be deleted. [ 1255.878863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.879473] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.946668] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.946907] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f472a668-4442-488d-936d-2a700ed0a421 is going to be deleted. [ 1255.947766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.947988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.953834] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.954089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.006747] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.006869] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30172372-1775-4005-bb5c-5e216ae55211 is going to be deleted. [ 1256.007772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.008070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.044199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.044351] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cc3c5b-5d64-430b-ba1a-61805cb1246f is going to be deleted. [ 1256.045321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.045610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.047117] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.047235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.071991] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.072138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.108258] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.108399] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6970c294-30ba-4814-9be8-ff7a47ecd5e8 is going to be deleted. [ 1256.109570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.109809] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.128745] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.128745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.189455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.189655] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3f12117-47c0-49e5-a9ee-6998ac5d5281 is going to be deleted. [ 1256.190524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.190782] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.214474] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.214700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.244157] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.244356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.264321] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.264321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.270161] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.270303] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5 is going to be deleted. [ 1256.271271] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.271496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.341863] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.342029] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65db01b4-9be5-4612-9e1c-a336eb7f22d1 is going to be deleted. [ 1256.342938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.343177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.409363] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.409567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.456424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.456611] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083 is going to be deleted. [ 1256.457534] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.457761] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.484082] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.484297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.530699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.531147] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c79582fb-f77d-4ad5-82e7-7e6d22e686de is going to be deleted. [ 1256.531902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.532203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.574422] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.574634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.590864] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.591018] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.596499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.596561] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1e2df-169e-4c48-af3a-0f40af269363 is going to be deleted. [ 1256.597928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.597928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.598095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.598163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9125373b-7375-4872-9f2e-c95f9102b178" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.598746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.598746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.598746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.598746] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb36a1e8-ba8d-491f-8291-18b58f2dfd6e" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.599262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.599429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.599509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.599721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0e1e5d-6b69-4241-b187-86836e4d9086" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.599784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.599881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.599959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.600089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed87eef5-439b-4752-b6cf-ead13a28e49a" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.600770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.600933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.601070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.601143] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae409816-e898-46fe-b06e-b955dd9008ef" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.601275] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.601420] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.601488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.601652] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5166db24-d7b9-43dd-8152-fa49fdb2e750" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.601714] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.601857] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.601934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.602085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4c1c41-3e51-4f2c-b0f0-da054bcade26" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.602255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.602356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.602427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.602542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c78203ee-b32f-401b-9764-682ada8423c6" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.602719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.602799] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.603039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.603039] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ef83a8-ad90-4c5e-987a-1f28536fa472" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.603132] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.603242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.603315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.603418] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f472a668-4442-488d-936d-2a700ed0a421" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.603570] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.603711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.603824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.603890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.604020] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.604158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.604231] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.604338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cc3c5b-5d64-430b-ba1a-61805cb1246f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.604457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.604589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.604667] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.604779] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6970c294-30ba-4814-9be8-ff7a47ecd5e8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.604904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.605055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.605129] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.605239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3f12117-47c0-49e5-a9ee-6998ac5d5281" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.605360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.605525] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.605587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.605701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b10051c7-0ad3-4bf9-b5ee-fa1f4151c0e5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.605830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.605965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.606050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.606156] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65db01b4-9be5-4612-9e1c-a336eb7f22d1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.606279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.606413] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.606491] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.606666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cfcbb3d-ca1c-491a-8a6c-dd9763ce9083" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.673122] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.673312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.673355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.673564] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.673658] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.673786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c79582fb-f77d-4ad5-82e7-7e6d22e686de" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.804912] env[65107]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1256.805671] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.805884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.805940] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.806167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.806261] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.806388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1e2df-169e-4c48-af3a-0f40af269363" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.476648] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 in Status: SUCCESS [ 1257.476924] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eddc4b52-aa90-46fd-ba26-8d960baeb169 deletion is rescheduled due to dependency. [ 1257.477124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eddc4b52-aa90-46fd-ba26-8d960baeb169" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.665874] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1257.666226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.666353] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.666577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.666820] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.666954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.667033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.667212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.667330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.667443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.667541] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.174058] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.676575] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfc0215e-9e19-4ef1-8f09-6aafac54a47f: rpc.has_security_group_logging(os_id): False [ 1258.695270] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.695536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.695536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.695766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.715752] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.716062] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.716188] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.716257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.716457] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.716571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.716679] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1258.779567] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.779730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.779790] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.780179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.780179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.794115] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1260.358269] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.358659] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1260.809172] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1260.809494] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.809765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.810098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.810209] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.313788] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.314059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.314059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.314268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.314494] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.314695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.314695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.314825] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.314914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.314998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.315105] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.817664] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.160575] env[65107]: INFO networking_nsxv3.common.synchronization [req-8a747d69-fd21-46a3-83eb-9c30eff880e7 req-c4998354-7487-4dc7-8452-c37b4b86faca tempest-ServerTagsTestJSON-1947702567 tempest-ServerTagsTestJSON-1947702567-project-member] Enqueued Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_members [ 1262.161473] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_members [ 1262.161473] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7b181a-73f7-466a-aade-99ba53db2982 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.161593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.161593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.161907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.162117] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.162229] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.162537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.162537] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.162711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.162711] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.320315] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfc0215e-9e19-4ef1-8f09-6aafac54a47f: rpc.has_security_group_logging(os_id): False [ 1262.339201] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.339201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.339201] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.339510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.339620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.340026] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.340131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.340197] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.340364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.340445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.340683] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1262.416286] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.416538] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.416598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.416855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.417098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.434515] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1262.487064] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.487064] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-320" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.487064] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-320" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.487463] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-320" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.488171] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.488378] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.488509] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.488743] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.488919] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.489171] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1262.489290] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.489370] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.489525] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.489742] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1262.489742] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.489896] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.516685] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.516941] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1262.517168] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.517411] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-320" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.517848] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-b550bf75-7516-4eb0-9fa3-e04948e63b7f taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.518184] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.518387] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.518746] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.518943] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b550bf75-7516-4eb0-9fa3-e04948e63b7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.665271] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.665567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.665567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.665810] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.665905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.666131] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.666251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.666315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.666445] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.666517] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.666609] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7b181a-73f7-466a-aade-99ba53db2982 already deleted. [ 1262.666683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.022102] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.022102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.022102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.022102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.022102] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.023334] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port b550bf75-7516-4eb0-9fa3-e04948e63b7f not found, creating... [ 1263.023334] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.023334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.023334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.023633] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.023633] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.023986] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.024184] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.024305] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.024523] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.024667] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.024792] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: b550bf75-7516-4eb0-9fa3-e04948e63b7f is going to be created. [ 1263.050896] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.051165] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.051290] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.051608] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.051840] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.052140] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.769938] env[65107]: INFO networking_nsxv3.common.synchronization [req-8a747d69-fd21-46a3-83eb-9c30eff880e7 req-f4076115-ca21-4404-a596-9e6123ee294b service nova] Enqueued Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_rules [ 1263.770276] env[65107]: INFO networking_nsxv3.common.synchronization [req-8a747d69-fd21-46a3-83eb-9c30eff880e7 req-f4076115-ca21-4404-a596-9e6123ee294b service nova] Enqueued Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_members [ 1263.770531] env[65107]: INFO networking_nsxv3.common.synchronization [req-8a747d69-fd21-46a3-83eb-9c30eff880e7 req-f4076115-ca21-4404-a596-9e6123ee294b service nova] Enqueued Resource ID: b550bf75-7516-4eb0-9fa3-e04948e63b7f with Priority: HIGHEST for action port [ 1263.771378] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_rules [ 1263.771539] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_members [ 1263.771731] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b550bf75-7516-4eb0-9fa3-e04948e63b7f with Priority: HIGHEST for action port [ 1263.772205] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba7b181a-73f7-466a-aade-99ba53db2982 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.772410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.772545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.772904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.773051] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.774240] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7b181a-73f7-466a-aade-99ba53db2982 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.774393] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.774474] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.774729] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.774947] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.775545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.775545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.775545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.775545] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.775758] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.777041] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-b550bf75-7516-4eb0-9fa3-e04948e63b7f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.777041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.777041] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.777266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.777329] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b550bf75-7516-4eb0-9fa3-e04948e63b7f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.279969] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7b181a-73f7-466a-aade-99ba53db2982 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.280320] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.280526] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.281770] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b550bf75-7516-4eb0-9fa3-e04948e63b7f with status ACTIVE [ 1264.282096] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.282285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.282412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.283361] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.283571] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.283850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.284037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.284163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.284433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.284579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.284891] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.285042] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.285119] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.285279] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.285708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.285708] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b550bf75-7516-4eb0-9fa3-e04948e63b7f is going to be updated. [ 1264.311716] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.311913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.311913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.312175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.312318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.312477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b550bf75-7516-4eb0-9fa3-e04948e63b7f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.453157] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1264.453412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.783416] env[65107]: INFO networking_nsxv3.common.synchronization [None req-b9e07401-118e-4683-84a9-8ae6f10d0438 tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_rules [ 1264.784079] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_rules [ 1264.784404] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-624b504e-f2cb-4f76-b943-c61aa08164f8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.784523] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.784592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.784860] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.784939] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.788262] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.862955] env[65107]: INFO networking_nsxv3.common.synchronization [None req-6f69b41b-e0eb-4b4a-a222-1cf66734b0dc tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_rules [ 1264.863555] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_rules [ 1264.863891] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-624b504e-f2cb-4f76-b943-c61aa08164f8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.863987] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.290857] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.291355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.291414] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.291659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.291841] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.291983] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7b181a-73f7-466a-aade-99ba53db2982 is going to be created. [ 1265.311886] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.312139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.312139] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.312346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.312395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.312485] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 already deleted. [ 1265.312555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.312781] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.314481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.314481] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.329630] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.329791] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.329868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.330079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.330239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.342431] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7b181a-73f7-466a-aade-99ba53db2982 in Status: UNINITIALIZED for 2s [ 1265.453266] env[65107]: INFO networking_nsxv3.common.synchronization [req-b8e807b5-2918-4f8c-a159-096b8f3c866e req-57ddd5dd-b01a-4c5d-a3a3-e9a419cd2a95 tempest-AttachVolumeTestJSON-481995887 tempest-AttachVolumeTestJSON-481995887-project-member] Enqueued Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_members [ 1265.453840] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b54cadd8-8b2d-427a-b017-3c0370790709 with Priority: HIGHEST for action security_group_members [ 1265.455427] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-b54cadd8-8b2d-427a-b017-3c0370790709 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.455565] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.455663] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.456181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.456181] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.456181] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.456306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.456340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.456423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.456515] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b54cadd8-8b2d-427a-b017-3c0370790709',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.844043] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.844251] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.844346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.844634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.844749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.844901] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 already deleted. [ 1265.845037] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.958774] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.958975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.958975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.959530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.982239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.982500] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.982624] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.982684] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.982890] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.982974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.983077] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b54cadd8-8b2d-427a-b017-3c0370790709 is going to be updated. [ 1266.016294] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.016294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.016294] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.016673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.016673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.027344] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b54cadd8-8b2d-427a-b017-3c0370790709 in Status: IN_PROGRESS for 2s [ 1266.672578] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.672960] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.673016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.673415] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.673822] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.674095] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.674276] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.674672] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.674919] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.675241] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1266.675424] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.675650] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.675853] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.676050] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1266.676238] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.676465] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.699409] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.699629] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1266.699817] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.700061] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-230" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.700516] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-6e3dec7a-fe46-4b30-8cae-72355686b30c taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.700767] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.700949] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.701323] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.701525] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e3dec7a-fe46-4b30-8cae-72355686b30c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.204758] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.205144] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.205374] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.205787] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.206028] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.206445] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.206696] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.206845] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.207146] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.207320] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.207746] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.208030] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.208250] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.208568] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.208854] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.209052] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c is going to be updated. [ 1267.233957] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.234204] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.234377] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.234688] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.234882] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.235289] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.353853] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7b181a-73f7-466a-aade-99ba53db2982 in Status: SUCCESS [ 1267.354126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.354297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.354508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.354709] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.354830] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.354964] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.355064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.355145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.355233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.355323] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.857942] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7b181a-73f7-466a-aade-99ba53db2982 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.858395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.858395] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.858506] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.858832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.858832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.858935] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.859049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.859131] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.859227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.859421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7b181a-73f7-466a-aade-99ba53db2982 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.859519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.859579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.859727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.859870] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.859959] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.860031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.860225] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.860308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.860463] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.860568] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.945737] env[65107]: INFO networking_nsxv3.common.synchronization [req-5e32fd3e-1214-4750-b125-08cf4aa509ab req-847b7851-7916-4603-aae6-25b29b525119 service nova] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1267.945861] env[65107]: INFO networking_nsxv3.common.synchronization [req-5e32fd3e-1214-4750-b125-08cf4aa509ab req-847b7851-7916-4603-aae6-25b29b525119 service nova] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1267.946215] env[65107]: INFO networking_nsxv3.common.synchronization [req-5e32fd3e-1214-4750-b125-08cf4aa509ab req-847b7851-7916-4603-aae6-25b29b525119 service nova] Enqueued Resource ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c with Priority: HIGHEST for action port [ 1267.946965] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_rules [ 1267.947315] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1267.947479] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c with Priority: HIGHEST for action port [ 1267.947889] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.948162] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.948239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.948675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.948780] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.950608] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.950608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.950608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.950992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.951175] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.951298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.951346] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.951594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.951640] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.951882] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.952839] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e3dec7a-fe46-4b30-8cae-72355686b30c taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.952934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.952973] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.953301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.954986] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e3dec7a-fe46-4b30-8cae-72355686b30c',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.046144] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b54cadd8-8b2d-427a-b017-3c0370790709 in Status: SUCCESS [ 1268.046144] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b54cadd8-8b2d-427a-b017-3c0370790709 deletion is rescheduled due to dependency. [ 1268.046369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b54cadd8-8b2d-427a-b017-3c0370790709" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.364856] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba7b181a-73f7-466a-aade-99ba53db2982: rpc.has_security_group_logging(os_id): False [ 1268.391968] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.392148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.392219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.392443] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.392536] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.392748] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.392845] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.392904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.393060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.393138] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.393320] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.393412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.393470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.393660] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.393697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.393878] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.393971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.394038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.394180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.394252] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.394334] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba7b181a-73f7-466a-aade-99ba53db2982 is going to be created. [ 1268.456363] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.456363] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.456557] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.457638] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e3dec7a-fe46-4b30-8cae-72355686b30c with status ACTIVE [ 1268.458590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.458590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.458590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.458590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.458590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.458590] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.458590] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.458864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.458864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.458864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.459211] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.459312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.459312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.459446] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.459511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.459596] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e3dec7a-fe46-4b30-8cae-72355686b30c is going to be updated. [ 1268.466754] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.466913] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.466996] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.467203] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.467379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.480315] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba7b181a-73f7-466a-aade-99ba53db2982 in Status: IN_PROGRESS for 2s [ 1268.485869] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.486021] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.486078] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.486286] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.486421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.486579] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e3dec7a-fe46-4b30-8cae-72355686b30c" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.962016] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.465073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.465282] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.465322] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.465556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.465699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.465808] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30172372-1775-4005-bb5c-5e216ae55211 is going to be updated. [ 1269.495784] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.495997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.495997] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.496224] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.496387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.506798] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: IN_PROGRESS for 2s [ 1269.875791] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.876028] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.876174] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.876470] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.876957] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.876957] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.877110] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.877273] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.877422] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.877753] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.877867] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.877987] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.878116] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.878227] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.878331] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.878474] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.904493] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.904715] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1269.904876] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.905107] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-755" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.905476] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.905700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.905836] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.906174] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.906351] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a39c781-a4b2-4eeb-9ef9-21d14fde6206',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.408822] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.409257] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.409257] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.409427] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.409581] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.409880] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.410126] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.410270] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.410498] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.410636] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.410930] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.411096] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.411211] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.411414] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.411547] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.411684] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 is going to be updated. [ 1270.432263] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.432462] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.432585] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.432852] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.433057] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.433314] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.503346] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba7b181a-73f7-466a-aade-99ba53db2982 in Status: SUCCESS [ 1270.503593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.129096] env[65107]: INFO networking_nsxv3.common.synchronization [req-265c9302-dd19-4873-a93c-a6afff42f43d req-5d6e3329-cf4f-4bcf-bbb0-8ba3733ad46f service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 1271.129420] env[65107]: INFO networking_nsxv3.common.synchronization [req-265c9302-dd19-4873-a93c-a6afff42f43d req-5d6e3329-cf4f-4bcf-bbb0-8ba3733ad46f service nova] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1271.129642] env[65107]: INFO networking_nsxv3.common.synchronization [req-265c9302-dd19-4873-a93c-a6afff42f43d req-5d6e3329-cf4f-4bcf-bbb0-8ba3733ad46f service nova] Enqueued Resource ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 with Priority: HIGHEST for action port [ 1271.130545] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_rules [ 1271.130655] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1271.130781] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 with Priority: HIGHEST for action port [ 1271.131442] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.131442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.131442] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.131588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.131673] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.133794] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.133794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.133794] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.134058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.134301] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.134452] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.134548] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.134785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.134931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.135443] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.136218] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.136382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.136470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.136700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.136843] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a39c781-a4b2-4eeb-9ef9-21d14fde6206',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.516554] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: SUCCESS [ 1271.516971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.517058] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.517324] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.517575] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.517733] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.517840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.518049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.518133] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.518226] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.518362] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.639332] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.640500] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.640619] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.640786] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 with status ACTIVE [ 1271.640948] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.641098] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.641151] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.641352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.641454] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.641641] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.641745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.641864] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.642063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.642146] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.642532] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.642690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.642757] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.642876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.642965] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.643722] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a39c781-a4b2-4eeb-9ef9-21d14fde6206 is going to be updated. [ 1271.670849] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.671054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.671145] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.671357] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.671503] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.671674] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a39c781-a4b2-4eeb-9ef9-21d14fde6206" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.021098] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.145256] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.524284] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30172372-1775-4005-bb5c-5e216ae55211: rpc.has_security_group_logging(os_id): False [ 1272.551982] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.551982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.551982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.551982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.551982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.552285] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.552285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.552366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.555826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.555826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.555826] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30172372-1775-4005-bb5c-5e216ae55211 is going to be created. [ 1272.624743] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.625059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.625124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.625408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.625730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.648349] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.648592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.648704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.648988] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.649165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.649311] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1272.652288] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: IN_PROGRESS for 2s [ 1272.685821] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.685821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.685821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.685821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.686352] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.724969] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1273.757980] env[65107]: INFO networking_nsxv3.common.synchronization [req-85b6c9cc-92c1-46a3-8dc2-0e797b7445ee req-bf9c9ed2-51c0-44fe-9798-db0cc69f17b3 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1273.758816] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1273.759056] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.759308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.759424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.759649] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.759854] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.760029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.760130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.760301] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.760390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.760530] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.265881] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.418314] env[65107]: INFO networking_nsxv3.common.synchronization [req-1a5f27d3-a223-4b83-a5d7-22fed55caaab req-529619ad-0cd6-46c7-8c83-193983fa5ded tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_members [ 1274.418796] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_members [ 1274.419440] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-624b504e-f2cb-4f76-b943-c61aa08164f8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.419583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.419661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.420530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.420530] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.420530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.420530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.420530] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.420801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.420801] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.670158] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: SUCCESS [ 1274.670345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.735198] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1274.735526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.735804] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.736167] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.736467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.736664] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.736785] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.737033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.737198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.737315] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.737455] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.769981] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.821825] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.821825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.821825] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.822348] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.822603] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.822786] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.822908] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.823163] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.823317] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.823529] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.824508] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.824508] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.824508] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.824508] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.824508] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.824508] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.846823] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.846823] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.847198] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.847444] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.847919] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-66670d4e-28e7-4f4c-9c28-b9771520abc1 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.848221] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.848406] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.848840] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.849252] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66670d4e-28e7-4f4c-9c28-b9771520abc1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.923157] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.923332] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.923427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.923701] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.923838] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.924205] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.924312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.924312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.924519] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.924647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.924754] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 already deleted. [ 1274.924846] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.239806] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.271147] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.271355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.271451] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.271630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.271728] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.271827] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be is going to be updated. [ 1275.309742] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.310090] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.310175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.310515] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.310755] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.323950] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: IN_PROGRESS for 2s [ 1275.351580] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.351930] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.352039] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.352340] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.352434] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.352591] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 66670d4e-28e7-4f4c-9c28-b9771520abc1 not found, creating... [ 1275.352866] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.353047] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.353226] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.353485] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.353611] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.353960] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.354138] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.354302] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.354483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.354603] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.354743] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 66670d4e-28e7-4f4c-9c28-b9771520abc1 is going to be created. [ 1275.387740] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.388110] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.388320] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.388704] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.388976] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.389500] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.742417] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11705357-9323-4e1c-bf51-81c8b975ee5d: rpc.has_security_group_logging(os_id): False [ 1275.765044] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.765305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.765408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.765774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.790958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.791567] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.791655] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.791766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.792073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.792196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.792360] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1275.879828] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.879828] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.880081] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.880171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.880376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.897264] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1276.144580] env[65107]: INFO networking_nsxv3.common.synchronization [req-1a5f27d3-a223-4b83-a5d7-22fed55caaab req-69d19bad-c316-44d6-9229-d49bec8d57f2 service nova] Enqueued Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_rules [ 1276.144805] env[65107]: INFO networking_nsxv3.common.synchronization [req-1a5f27d3-a223-4b83-a5d7-22fed55caaab req-69d19bad-c316-44d6-9229-d49bec8d57f2 service nova] Enqueued Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_members [ 1276.144895] env[65107]: INFO networking_nsxv3.common.synchronization [req-1a5f27d3-a223-4b83-a5d7-22fed55caaab req-69d19bad-c316-44d6-9229-d49bec8d57f2 service nova] Enqueued Resource ID: 66670d4e-28e7-4f4c-9c28-b9771520abc1 with Priority: HIGHEST for action port [ 1276.145464] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_rules [ 1276.145612] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_members [ 1276.145817] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66670d4e-28e7-4f4c-9c28-b9771520abc1 with Priority: HIGHEST for action port [ 1276.146462] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-624b504e-f2cb-4f76-b943-c61aa08164f8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.146610] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.146683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.146892] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.146978] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.148273] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-624b504e-f2cb-4f76-b943-c61aa08164f8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.148629] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.148716] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.148933] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.149197] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.149259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.149309] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.149483] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.149574] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.149669] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.152498] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-66670d4e-28e7-4f4c-9c28-b9771520abc1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.152498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.152498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.152498] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.152498] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66670d4e-28e7-4f4c-9c28-b9771520abc1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.653883] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.655421] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-624b504e-f2cb-4f76-b943-c61aa08164f8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.656507] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.656507] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66670d4e-28e7-4f4c-9c28-b9771520abc1 with status ACTIVE [ 1276.656507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.656699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.656699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.656980] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.657290] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.657578] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.657759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.657868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.658152] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.658589] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.658680] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.659296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.659468] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.659741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.659873] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.660016] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66670d4e-28e7-4f4c-9c28-b9771520abc1 is going to be updated. [ 1276.697676] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.697840] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.697912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.698189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.698331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.698495] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66670d4e-28e7-4f4c-9c28-b9771520abc1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.703899] env[65107]: INFO networking_nsxv3.common.synchronization [req-0c03cb8b-ba8a-4527-8fff-0c5e63d9e471 req-002e509d-577b-4c56-8755-1943b01b43dc tempest-ServerTagsTestJSON-1947702567 tempest-ServerTagsTestJSON-1947702567-project-member] Enqueued Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_members [ 1276.704744] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7b181a-73f7-466a-aade-99ba53db2982 with Priority: HIGHEST for action security_group_members [ 1276.704845] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7b181a-73f7-466a-aade-99ba53db2982 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.705439] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.705513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.705759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.705934] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.706092] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.706160] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.706335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.706424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.706524] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba7b181a-73f7-466a-aade-99ba53db2982',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.156809] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.209068] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.209274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.209274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.209508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.209608] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.209818] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.209927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.209991] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.210154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.210233] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.210320] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7b181a-73f7-466a-aade-99ba53db2982 is going to be updated. [ 1277.240518] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.240720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.240768] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.240989] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.241148] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.252321] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7b181a-73f7-466a-aade-99ba53db2982 in Status: IN_PROGRESS for 2s [ 1277.335645] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: SUCCESS [ 1277.335870] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.659361] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.659540] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.660876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.660876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.660876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.660876] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 is going to be created. [ 1277.685283] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.685541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.685541] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.685801] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.685984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.696407] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 in Status: UNINITIALIZED for 2s [ 1277.914461] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1277.914736] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.263019] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7b181a-73f7-466a-aade-99ba53db2982 in Status: IN_PROGRESS for 4s [ 1279.706609] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 in Status: SUCCESS [ 1279.706859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.707158] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.707419] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.707657] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.707806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.707928] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.708153] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.708289] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.708428] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.708582] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.210898] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.713907] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 624b504e-f2cb-4f76-b943-c61aa08164f8: rpc.has_security_group_logging(os_id): False [ 1280.732754] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.733062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.733062] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.733219] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.733316] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.733566] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.733694] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.733774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.734510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.734510] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.734510] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 is going to be created. [ 1280.805420] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.805616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.805670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.806066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.806202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.818962] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 in Status: IN_PROGRESS for 2s [ 1281.274632] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7b181a-73f7-466a-aade-99ba53db2982 in Status: SUCCESS [ 1281.275034] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7b181a-73f7-466a-aade-99ba53db2982 deletion is rescheduled due to dependency. [ 1281.275128] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7b181a-73f7-466a-aade-99ba53db2982" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.705873] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.706089] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1282.833922] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 in Status: SUCCESS [ 1282.833922] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.707219] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.707219] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.139015] env[65107]: INFO networking_nsxv3.common.synchronization [req-caea377d-07a7-4c0b-9560-60cff6a0cec1 req-57a7e2f5-ef0a-46ba-9bf4-dcd22cadccc5 tempest-ServerActionsTestOtherB-1594477749 tempest-ServerActionsTestOtherB-1594477749-project-member] Enqueued Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1290.139645] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11705357-9323-4e1c-bf51-81c8b975ee5d with Priority: HIGHEST for action security_group_members [ 1290.139975] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-11705357-9323-4e1c-bf51-81c8b975ee5d taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.140120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.140189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.140402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.141826] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.141826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.141826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.141826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.141826] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.141826] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11705357-9323-4e1c-bf51-81c8b975ee5d',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.645072] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.645072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.645072] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.645480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.645617] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.645963] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.646170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.646298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.646559] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.646774] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.646948] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d is going to be updated. [ 1290.678961] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.679205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.679205] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.679391] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.679532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.689209] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: IN_PROGRESS for 2s [ 1291.786323] env[65107]: INFO networking_nsxv3.common.synchronization [req-fc02be4e-662e-4a6b-97da-2cd575f44517 req-516784c9-6b09-42c5-8d5f-c922385f3592 tempest-ServerActionsTestOtherA-1275245699 tempest-ServerActionsTestOtherA-1275245699-project-member] Enqueued Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1291.786876] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be with Priority: HIGHEST for action security_group_members [ 1291.787721] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4a7699-28a9-417a-9e0b-bf15ce0027be taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.787721] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.787881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.788546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.788546] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.788546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.788546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.788546] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.788851] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.788851] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4a7699-28a9-417a-9e0b-bf15ce0027be',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.291186] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.291400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.291480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.291718] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.312582] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.312819] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.312947] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.313029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.313266] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.313355] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.313479] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be is going to be updated. [ 1292.343182] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.343338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.343415] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.343666] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.343834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.354325] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: IN_PROGRESS for 2s [ 1292.700071] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11705357-9323-4e1c-bf51-81c8b975ee5d in Status: SUCCESS [ 1292.700231] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11705357-9323-4e1c-bf51-81c8b975ee5d deletion is rescheduled due to dependency. [ 1292.700360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11705357-9323-4e1c-bf51-81c8b975ee5d" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.364918] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be in Status: SUCCESS [ 1294.364918] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4a7699-28a9-417a-9e0b-bf15ce0027be deletion is rescheduled due to dependency. [ 1294.364918] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4a7699-28a9-417a-9e0b-bf15ce0027be" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.787984] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.788314] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.788837] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.789225] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.918973] env[65107]: INFO networking_nsxv3.common.synchronization [None req-fc74e584-57ea-4772-a963-a7b3abc10b5f None None] Enqueued Resource ID: 0f58a368-891a-4243-b431-13113de53de5 with Priority: HIGHEST for action port [ 1301.919260] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f58a368-891a-4243-b431-13113de53de5 with Priority: HIGHEST for action port [ 1301.919832] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f58a368-891a-4243-b431-13113de53de5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.919958] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f58a368-891a-4243-b431-13113de53de5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.920040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f58a368-891a-4243-b431-13113de53de5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.920305] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f58a368-891a-4243-b431-13113de53de5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.920394] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f58a368-891a-4243-b431-13113de53de5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.422984] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f58a368-891a-4243-b431-13113de53de5 [ 1302.422984] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.423176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.423176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.423298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.423387] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.423475] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f58a368-891a-4243-b431-13113de53de5 already deleted. [ 1302.423550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f58a368-891a-4243-b431-13113de53de5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.937709] env[65107]: INFO networking_nsxv3.common.synchronization [None req-7fcf4fa3-3fb0-4c93-bba7-7097d3fe13a4 None None] Enqueued Resource ID: 98e87bc3-529f-41f7-80a0-7d4218f355e1 with Priority: HIGHEST for action port [ 1303.938265] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e87bc3-529f-41f7-80a0-7d4218f355e1 with Priority: HIGHEST for action port [ 1303.938621] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-98e87bc3-529f-41f7-80a0-7d4218f355e1 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.938748] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98e87bc3-529f-41f7-80a0-7d4218f355e1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.938813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98e87bc3-529f-41f7-80a0-7d4218f355e1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.939079] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98e87bc3-529f-41f7-80a0-7d4218f355e1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.939165] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98e87bc3-529f-41f7-80a0-7d4218f355e1',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.441298] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98e87bc3-529f-41f7-80a0-7d4218f355e1 [ 1304.441555] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.441688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.441756] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.441982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.442089] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.442187] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98e87bc3-529f-41f7-80a0-7d4218f355e1 already deleted. [ 1304.442268] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98e87bc3-529f-41f7-80a0-7d4218f355e1" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.140245] env[65107]: INFO networking_nsxv3.common.synchronization [req-020e07d2-d1e3-45e3-a76d-d8c77745a9bf req-c9e02e1f-5008-472d-8702-187e966dda8f tempest-ServerRescueTestJSON-1826020292 tempest-ServerRescueTestJSON-1826020292-project-member] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1307.140578] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1307.140889] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.141014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.141221] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.141520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.141743] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.141927] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.142038] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.142242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.142375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.142507] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.406047] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.406047] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.406047] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.406428] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.406687] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.406849] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.406977] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.407245] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.407384] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.407591] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.407703] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1307.407810] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1307.407917] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1307.408034] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.408140] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1307.408270] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1307.427296] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1307.427451] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1307.427581] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1307.427757] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.428065] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-e344a6de-acf0-4570-af70-ac6393cf3d40 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.428239] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.428358] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.428673] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.428805] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e344a6de-acf0-4570-af70-ac6393cf3d40',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.645106] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.645335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.645335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.645520] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.645717] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.645956] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.646137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.646213] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.646406] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.646511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.646620] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 already deleted. [ 1307.646725] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.931575] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.931808] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.931923] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.932225] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.932376] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.932528] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port e344a6de-acf0-4570-af70-ac6393cf3d40 not found, creating... [ 1307.932785] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.932942] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.933073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.933294] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.933431] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.933708] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.933864] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.933980] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.934195] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.934326] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.934460] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: e344a6de-acf0-4570-af70-ac6393cf3d40 is going to be created. [ 1307.954846] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.955050] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.955181] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.955438] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.955707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.955927] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.660687] env[65107]: INFO networking_nsxv3.common.synchronization [req-020e07d2-d1e3-45e3-a76d-d8c77745a9bf req-1c48250f-f7e5-4a30-8ec6-8c0fa3994af9 service nova] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_rules [ 1308.661076] env[65107]: INFO networking_nsxv3.common.synchronization [req-020e07d2-d1e3-45e3-a76d-d8c77745a9bf req-1c48250f-f7e5-4a30-8ec6-8c0fa3994af9 service nova] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1308.661076] env[65107]: INFO networking_nsxv3.common.synchronization [req-020e07d2-d1e3-45e3-a76d-d8c77745a9bf req-1c48250f-f7e5-4a30-8ec6-8c0fa3994af9 service nova] Enqueued Resource ID: e344a6de-acf0-4570-af70-ac6393cf3d40 with Priority: HIGHEST for action port [ 1308.661923] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_rules [ 1308.662160] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1308.662357] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e344a6de-acf0-4570-af70-ac6393cf3d40 with Priority: HIGHEST for action port [ 1308.662755] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.662931] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.663048] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.663369] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.663503] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.665376] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.665477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.665595] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.665886] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.665886] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.666025] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.666084] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.666259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.666366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.666469] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.667298] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-e344a6de-acf0-4570-af70-ac6393cf3d40 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.667408] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.667492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.667659] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.667736] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e344a6de-acf0-4570-af70-ac6393cf3d40',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.166148] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.166390] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.169711] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.170642] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e344a6de-acf0-4570-af70-ac6393cf3d40 with status ACTIVE [ 1309.170872] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.171066] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.171130] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.171386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.171484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.171668] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.171766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.171847] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.172304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.172304] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.172431] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.172488] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.172524] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.172998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.172998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.172998] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e344a6de-acf0-4570-af70-ac6393cf3d40 is going to be updated. [ 1309.195067] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.195287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.195287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.195477] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.195616] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.195772] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e344a6de-acf0-4570-af70-ac6393cf3d40" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.674835] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.177724] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.177896] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.178014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.178311] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.178460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.178611] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 is going to be created. [ 1310.203217] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.203472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.203472] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.203720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.203905] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.212707] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: UNINITIALIZED for 2s [ 1312.224036] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: SUCCESS [ 1312.224036] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.224386] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.224470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.224987] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.225184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.225246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.225423] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.225508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.225594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.225686] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.728341] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.728673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.728673] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.728891] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.729118] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.729254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.729333] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.729532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.729630] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.729720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.729876] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.729971] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.730059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.730238] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.730389] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.730484] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.730543] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.730730] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.730821] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.730907] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.731037] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.233537] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccd45e2b-7207-47bd-969e-5bdc632777b8: rpc.has_security_group_logging(os_id): False [ 1313.252628] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.252812] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.252932] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.253120] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.253212] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.253420] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.253513] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.253587] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.253711] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.253786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.253974] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.254085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.254155] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.254296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.254370] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.254584] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.254679] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.254720] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.254865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.254925] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.255016] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 is going to be created. [ 1313.330984] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.331163] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.331240] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.331528] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.331813] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.347516] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: IN_PROGRESS for 2s [ 1313.663359] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.663580] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1315.359918] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: SUCCESS [ 1315.360321] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.664940] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.665263] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.079624] env[65107]: INFO networking_nsxv3.common.synchronization [req-0802ea61-1590-4e05-a878-2bb1d96614b9 req-3c7e005e-8f20-4d91-849a-91b8a40c876d tempest-AttachVolumeShelveTestJSON-994932741 tempest-AttachVolumeShelveTestJSON-994932741-project-member] Enqueued Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1322.080484] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30172372-1775-4005-bb5c-5e216ae55211 with Priority: HIGHEST for action security_group_members [ 1322.080818] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-30172372-1775-4005-bb5c-5e216ae55211 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.080976] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.081127] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.081388] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.081596] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.081784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.081784] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.081901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.081969] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.082852] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30172372-1775-4005-bb5c-5e216ae55211',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.584766] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.584995] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.585076] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.585306] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.585410] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.585637] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.585751] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.585827] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.585983] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.586093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.586181] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30172372-1775-4005-bb5c-5e216ae55211 is going to be updated. [ 1322.623829] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.624071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.624071] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.624296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.624481] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.637631] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: IN_PROGRESS for 2s [ 1324.648812] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30172372-1775-4005-bb5c-5e216ae55211 in Status: SUCCESS [ 1324.649124] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30172372-1775-4005-bb5c-5e216ae55211 deletion is rescheduled due to dependency. [ 1324.649124] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30172372-1775-4005-bb5c-5e216ae55211" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.081933] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.081933] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.106460] env[65107]: INFO networking_nsxv3.common.synchronization [req-81a0fb3d-8311-45cf-954d-a4607804d097 req-609090bc-5498-48ea-b9c8-b9a28672284b tempest-ServerRescueTestJSON-1826020292 tempest-ServerRescueTestJSON-1826020292-project-member] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1330.107382] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1330.107860] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.108059] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.108154] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.108464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.108719] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.108881] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.108982] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.109227] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.109471] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.109617] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.402826] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.403036] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.403161] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.403426] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.403678] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.403827] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.403939] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.404155] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.404315] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.404521] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.404630] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1330.404732] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1330.404851] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1330.404966] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.405084] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1330.405211] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1330.425489] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1330.425681] env[65107]: DEBUG dogpile.cache.region [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1330.425774] env[65107]: DEBUG dogpile.lock [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1330.425951] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "network-463" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.426289] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock port-91e11887-910f-4737-89c9-47845939a350 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.426537] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.426660] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.426992] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.427160] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91e11887-910f-4737-89c9-47845939a350',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.611923] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.930072] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.930385] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.930545] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.930872] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.931072] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.931277] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Segment Port 91e11887-910f-4737-89c9-47845939a350 not found, creating... [ 1330.931575] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.931738] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.931854] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.932088] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.932238] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.932515] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.932668] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.932776] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.932998] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.933153] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.933297] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Resource: SegmentPort with ID: 91e11887-910f-4737-89c9-47845939a350 is going to be created. [ 1330.953674] env[65107]: DEBUG networking_nsxv3.common.locking [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.954083] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.954240] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.954497] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.954779] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.955028] env[65107]: DEBUG oslo_concurrency.lockutils [None req-a98f3474-9867-4671-8246-46d3a1b6c9e5 None None] Releasing lock "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.113910] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.616243] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.616460] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.616542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.616766] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.616858] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.616955] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 is going to be updated. [ 1331.647495] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.649375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.649375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.649375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.649375] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.661476] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: IN_PROGRESS for 2s [ 1331.681832] env[65107]: INFO networking_nsxv3.common.synchronization [req-81a0fb3d-8311-45cf-954d-a4607804d097 req-a0929349-8331-486a-83e1-c4f64e9d1cb8 service nova] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_rules [ 1331.682031] env[65107]: INFO networking_nsxv3.common.synchronization [req-81a0fb3d-8311-45cf-954d-a4607804d097 req-a0929349-8331-486a-83e1-c4f64e9d1cb8 service nova] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1331.682174] env[65107]: INFO networking_nsxv3.common.synchronization [req-81a0fb3d-8311-45cf-954d-a4607804d097 req-a0929349-8331-486a-83e1-c4f64e9d1cb8 service nova] Enqueued Resource ID: 91e11887-910f-4737-89c9-47845939a350 with Priority: HIGHEST for action port [ 1331.682714] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_rules [ 1331.682855] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1331.682949] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e11887-910f-4737-89c9-47845939a350 with Priority: HIGHEST for action port [ 1331.683699] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.683832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.683904] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.684246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.684334] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.685682] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.686106] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.686839] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-91e11887-910f-4737-89c9-47845939a350 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.686974] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.687054] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.687216] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.687357] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91e11887-910f-4737-89c9-47845939a350',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.191512] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91e11887-910f-4737-89c9-47845939a350 with status ACTIVE [ 1332.191875] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.191875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.191875] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.192069] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.193661] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.193661] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.193661] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.193661] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91e11887-910f-4737-89c9-47845939a350 is going to be updated. [ 1332.194586] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.194678] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.215609] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.215754] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.215850] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.216040] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.216177] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.216338] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91e11887-910f-4737-89c9-47845939a350" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.671093] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: SUCCESS [ 1333.671470] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.671551] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.671889] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.672188] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.672429] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.672557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.672824] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.672884] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.672931] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.175291] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.524824] env[65107]: INFO networking_nsxv3.common.synchronization [req-4245a96b-dc37-4e08-8353-5dc283dfb9be req-16810060-758b-4649-b5fa-c5fe9a38cae8 tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1334.525363] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1334.525998] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.525998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.525998] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.526184] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.526310] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.526480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.526585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.526770] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.526862] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.526959] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.677531] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.029527] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.029731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.029731] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.029834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.029934] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.030146] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.030246] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.030308] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.030482] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.030567] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.030653] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1335.057129] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.057336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.057336] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.057556] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.057695] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.065819] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1335.179898] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.179898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.179898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.179898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.179898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.179898] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 is going to be updated. [ 1335.211790] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.211948] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.212010] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.212235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.212382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.222771] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: IN_PROGRESS for 2s [ 1337.076981] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1337.077456] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f deletion is rescheduled due to dependency. [ 1337.077456] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.233626] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: SUCCESS [ 1337.233808] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.233960] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.234199] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.234498] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.234622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.234688] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.234885] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.234979] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.235102] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.235243] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.738105] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.738287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.738360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.738586] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.738774] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.738871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.738920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.739085] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.739175] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.739263] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.739412] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.739504] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.739592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.739749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.739897] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.739993] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.740064] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.740202] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.740278] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.740360] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.740451] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.242865] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccd45e2b-7207-47bd-969e-5bdc632777b8: rpc.has_security_group_logging(os_id): False [ 1338.262107] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.262329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.262329] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.262527] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.262623] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.262819] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.263093] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.263141] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.263293] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.263365] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.263576] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.263670] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.263727] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.263914] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.264028] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.264232] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.264331] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.264389] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.264566] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.264786] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.264786] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 is going to be updated. [ 1338.351073] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.351073] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.351382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.351382] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.351522] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.372111] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: IN_PROGRESS for 2s [ 1339.317868] env[65107]: INFO networking_nsxv3.common.synchronization [req-bbaf79d4-364d-410c-bfe6-94024a340d48 req-cbbdb387-9d1c-482f-aec6-785c27d3e6fd tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_members [ 1339.317868] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 with Priority: HIGHEST for action security_group_members [ 1339.317868] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-624b504e-f2cb-4f76-b943-c61aa08164f8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.317868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.317868] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.318284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.318284] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.318284] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.318400] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.318492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.318615] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.318673] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('624b504e-f2cb-4f76-b943-c61aa08164f8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.821557] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.821773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.821773] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.822014] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.822126] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.822326] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.822427] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.822490] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.822647] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.822723] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.822809] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 is going to be updated. [ 1339.851460] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.851692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.851692] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.851902] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.852060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.860385] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 in Status: IN_PROGRESS for 2s [ 1340.387207] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: SUCCESS [ 1340.387585] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.873525] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 in Status: SUCCESS [ 1341.873919] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 624b504e-f2cb-4f76-b943-c61aa08164f8 deletion is rescheduled due to dependency. [ 1341.873919] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-624b504e-f2cb-4f76-b943-c61aa08164f8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.418054] env[65107]: INFO networking_nsxv3.common.synchronization [req-b6b3b628-0ddd-4965-a9ca-3d2acfdb673b req-5367c79b-4132-4a0f-8505-98c16806359e tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1342.418454] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1342.418789] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.418910] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.418975] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.419196] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.419348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.419449] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.419508] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.419653] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.419745] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.419840] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.742240] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.742474] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.742614] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.742902] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.743302] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.743480] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.743608] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.743851] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.744016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.744276] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.744411] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.744561] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.744706] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.744823] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.744959] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.745117] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.763906] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.764094] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1342.764235] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.764557] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-343" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.764884] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.765069] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.765187] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.765515] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.765650] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f685dc8c-1fc6-46c3-add3-e7d4b56ce296',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.922110] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.922509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.922509] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.922627] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.922719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.922973] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.923100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.923165] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.923325] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.923403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.923488] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1342.948943] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.949170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.949170] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.949347] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.949487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.958279] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1343.271246] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.271526] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.271666] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.271982] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.272176] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.272333] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port f685dc8c-1fc6-46c3-add3-e7d4b56ce296 not found, creating... [ 1343.272590] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.272785] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.272953] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.273192] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.273328] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.273609] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.273766] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.273878] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.274121] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.274268] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.274409] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: f685dc8c-1fc6-46c3-add3-e7d4b56ce296 is going to be created. [ 1343.301242] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.301483] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.301571] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.301837] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.302119] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.302347] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.000096] env[65107]: INFO networking_nsxv3.common.synchronization [req-b6b3b628-0ddd-4965-a9ca-3d2acfdb673b req-19841147-5767-4ec2-bcdd-b5a02f0eb220 service nova] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 1344.000394] env[65107]: INFO networking_nsxv3.common.synchronization [req-b6b3b628-0ddd-4965-a9ca-3d2acfdb673b req-19841147-5767-4ec2-bcdd-b5a02f0eb220 service nova] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1344.000492] env[65107]: INFO networking_nsxv3.common.synchronization [req-b6b3b628-0ddd-4965-a9ca-3d2acfdb673b req-19841147-5767-4ec2-bcdd-b5a02f0eb220 service nova] Enqueued Resource ID: f685dc8c-1fc6-46c3-add3-e7d4b56ce296 with Priority: HIGHEST for action port [ 1344.000645] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_rules [ 1344.000974] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1344.000974] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f685dc8c-1fc6-46c3-add3-e7d4b56ce296 with Priority: HIGHEST for action port [ 1344.001439] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.001577] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.001636] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.001839] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.002031] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.002809] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.002911] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.003156] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.003254] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.003345] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.003683] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.003766] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f685dc8c-1fc6-46c3-add3-e7d4b56ce296',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.140964] env[65107]: INFO networking_nsxv3.common.synchronization [None req-a6d0b71a-1d90-47f5-8f08-67f4cfb52f3c tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_rules [ 1344.141465] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_rules [ 1344.141778] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.141906] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.142186] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.142379] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.142468] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.221603] env[65107]: INFO networking_nsxv3.common.synchronization [None req-c1cbcffb-3810-48db-987b-63b6b6fff89b tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_rules [ 1344.222141] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_rules [ 1344.222459] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.222562] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.505716] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.505942] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.506065] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f685dc8c-1fc6-46c3-add3-e7d4b56ce296 with status ACTIVE [ 1344.506251] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.506366] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.506433] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.506753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.506855] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.507046] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.507137] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.507210] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.507364] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.507441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.507900] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.508029] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.508099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.508259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.508356] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.508429] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f685dc8c-1fc6-46c3-add3-e7d4b56ce296 is going to be updated. [ 1344.531507] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.531699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.531699] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.531937] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.532095] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.532255] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f685dc8c-1fc6-46c3-add3-e7d4b56ce296" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.669204] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.669412] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.669511] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.669795] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.669920] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.670067] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 already deleted. [ 1344.670189] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.670741] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.670953] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.671108] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.969324] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1344.969511] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f deletion is rescheduled due to dependency. [ 1344.969631] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.969805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.970055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.970251] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.970372] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.970437] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.970593] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.970675] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.970770] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.192173] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.192173] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.192601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.192601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.192601] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.192702] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 already deleted. [ 1345.192740] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.472731] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.978479] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.481369] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.481777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.481777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.481876] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.481912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.482021] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1346.508723] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.508950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.508950] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.509150] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.509297] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.519550] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1348.530487] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1348.530901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.530901] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.531083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.531348] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.531455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.531455] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.531598] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.531681] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.531765] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.531855] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.035073] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.223160] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.223361] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1349.536902] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfc0215e-9e19-4ef1-8f09-6aafac54a47f: rpc.has_security_group_logging(os_id): False [ 1349.555882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.556099] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.556176] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.556441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.556620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.556862] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.556984] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.557063] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.557232] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.557314] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.557404] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1349.627268] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.627462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.627462] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.627753] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.627954] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.642123] env[65107]: INFO networking_nsxv3.common.synchronization [req-59587bb8-0237-4cd0-aba9-0992f2832557 req-a86c0159-8547-4ced-b427-57b5507fd786 tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_members [ 1349.642123] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_members [ 1349.642502] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.642759] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.642834] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.643117] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.643276] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.643380] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.643441] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.643594] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.643680] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.643773] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.645222] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1349.939146] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.939334] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.939469] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.939794] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.940074] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.940237] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.940351] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.940565] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.940707] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.940919] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1349.941072] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] NeedRegenerationException {{(pid=65107) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1349.941187] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] no value, waiting for create lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1349.941304] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] value creation lock acquired {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1349.941417] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] No value present for key: 'zone-id' {{(pid=65107) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1349.941519] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Calling creation function for not-yet-present value {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1349.941649] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1349.960715] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1349.960928] env[65107]: DEBUG dogpile.cache.region [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65107) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1349.961103] env[65107]: DEBUG dogpile.lock [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Released creation lock {{(pid=65107) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1349.961280] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "network-666" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.961659] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 taken with stack trace [, , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.961849] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.962016] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.962279] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.962411] env[65107]: DEBUG networking_nsxv3.api.rpc [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5d2c86-1e46-4922-a9a1-f88be48fa0d7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.147033] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.147033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.147033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.147033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.147033] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.147417] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.147417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.147417] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.147622] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.147749] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.147858] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 already deleted. [ 1350.147963] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.465202] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.465458] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.465577] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.465890] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.466073] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.466250] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Segment Port 8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 not found, creating... [ 1350.466530] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.466740] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.466865] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.467110] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.467250] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.467527] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.467700] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.467833] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.468092] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.468241] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.468382] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Resource: SegmentPort with ID: 8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 is going to be created. [ 1350.488781] env[65107]: DEBUG networking_nsxv3.common.locking [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.489048] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.489172] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.489459] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.489695] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.489962] env[65107]: DEBUG oslo_concurrency.lockutils [None req-d8a8a8fb-b223-4b78-b4e2-650a988760f5 None None] Releasing lock "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.192557] env[65107]: INFO networking_nsxv3.common.synchronization [req-59587bb8-0237-4cd0-aba9-0992f2832557 req-bf71b653-3f10-42f8-9fb9-c058822ebcb1 service nova] Enqueued Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_rules [ 1351.192826] env[65107]: INFO networking_nsxv3.common.synchronization [req-59587bb8-0237-4cd0-aba9-0992f2832557 req-bf71b653-3f10-42f8-9fb9-c058822ebcb1 service nova] Enqueued Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_members [ 1351.192932] env[65107]: INFO networking_nsxv3.common.synchronization [req-59587bb8-0237-4cd0-aba9-0992f2832557 req-bf71b653-3f10-42f8-9fb9-c058822ebcb1 service nova] Enqueued Resource ID: 8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 with Priority: HIGHEST for action port [ 1351.193396] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_rules [ 1351.193536] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_members [ 1351.194267] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 with Priority: HIGHEST for action port [ 1351.194510] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.194634] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.194706] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.194897] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.194982] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.196287] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.196496] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.196690] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.196777] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.197489] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.197489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.197489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.197489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.197489] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.197489] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.198729] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.198832] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.199019] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.199180] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.199249] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5d2c86-1e46-4922-a9a1-f88be48fa0d7',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.660492] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1351.660492] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.697242] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.697464] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.699741] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.700970] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 with status ACTIVE [ 1351.701207] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.701334] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.701402] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.701603] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.701696] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.701882] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.701981] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.702055] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.702206] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.702285] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.702470] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.703050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.703050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.703050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.703050] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.703050] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c5d2c86-1e46-4922-a9a1-f88be48fa0d7 is going to be updated. [ 1351.727065] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.727262] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.727330] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.727532] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.727700] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.727871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5d2c86-1e46-4922-a9a1-f88be48fa0d7" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.204574] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.708060] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.708060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.708060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.708060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.708060] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.708060] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 is going to be created. [ 1352.731202] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.731403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.731403] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.731542] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.731697] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.740762] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 in Status: UNINITIALIZED for 2s [ 1354.175761] env[65107]: INFO networking_nsxv3.common.synchronization [req-205b1466-f9c3-4680-9f14-7ba25d2b172f req-c91ead92-60b0-48c6-a0e3-b906baf2e537 tempest-ServerRescueTestJSON-1826020292 tempest-ServerRescueTestJSON-1826020292-project-member] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1354.176386] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1354.177583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.177583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.177583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.177583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.177583] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.177583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.177583] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.178026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.178026] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.178026] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.680589] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.753092] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 in Status: SUCCESS [ 1354.753312] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.753487] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.753704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.753905] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.754031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.754100] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.754257] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.754339] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.754425] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.754526] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.183134] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.256573] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.685970] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.686171] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.686239] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.686557] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.686719] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.686869] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 is going to be updated. [ 1355.713713] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.713871] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.713912] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.714147] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.714296] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.723626] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: IN_PROGRESS for 2s [ 1355.759076] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5: rpc.has_security_group_logging(os_id): False [ 1355.777340] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.777555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.777555] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.777691] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.777806] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.778087] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.778198] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.778267] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.778421] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.778499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.778586] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 is going to be created. [ 1355.846818] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.847105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.847105] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.847298] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.847480] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.858684] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 in Status: IN_PROGRESS for 2s [ 1357.734451] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: SUCCESS [ 1357.734865] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.871726] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 in Status: SUCCESS [ 1357.871898] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.177531] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.177990] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.788714] env[65107]: INFO networking_nsxv3.common.synchronization [req-e2fcf286-85a6-4868-8a43-27d590e9a00a req-3003c1cb-c7c2-47b9-943a-0cea2a669be8 tempest-ServerRescueTestJSON-1826020292 tempest-ServerRescueTestJSON-1826020292-project-member] Enqueued Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1360.789241] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 with Priority: HIGHEST for action security_group_members [ 1360.789563] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd45e2b-7207-47bd-969e-5bdc632777b8 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.789686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.789760] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.789992] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.790295] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.790411] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.790476] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.790643] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.790732] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.790826] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd45e2b-7207-47bd-969e-5bdc632777b8',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.293202] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.293436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.293436] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.293650] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.293742] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.293940] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.294049] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.294107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.294260] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.294335] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.294420] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 is going to be updated. [ 1361.323850] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.324070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.324070] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.324283] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.324424] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.332386] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: IN_PROGRESS for 2s [ 1363.345198] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 in Status: SUCCESS [ 1363.345620] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd45e2b-7207-47bd-969e-5bdc632777b8 deletion is rescheduled due to dependency. [ 1363.345620] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd45e2b-7207-47bd-969e-5bdc632777b8" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.790020] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.790459] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1370.792202] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.792202] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.792714] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.793137] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.793400] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.793671] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.794773] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.795174] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.795783] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.796160] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.797367] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.797753] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.798428] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.798773] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.361566] env[65107]: INFO networking_nsxv3.common.synchronization [req-9f9afd7a-08f5-4082-acb6-129308a27c84 req-3b47a877-d5e1-487d-8c72-61d420a142cd tempest-ServerActionsTestJSON-130893720 tempest-ServerActionsTestJSON-130893720-project-member] Enqueued Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1405.362253] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f with Priority: HIGHEST for action security_group_members [ 1405.362626] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.362715] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.362775] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.362966] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.363134] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.363259] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.363300] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.363438] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.363553] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.363653] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc0215e-9e19-4ef1-8f09-6aafac54a47f',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.865786] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.866083] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.866235] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.866550] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.866704] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.867015] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.867183] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.867318] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.867549] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.867686] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.867828] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f is going to be updated. [ 1405.900965] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.901242] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.901376] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.901708] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.901938] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.911469] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: IN_PROGRESS for 2s [ 1407.922181] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f in Status: SUCCESS [ 1407.922606] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc0215e-9e19-4ef1-8f09-6aafac54a47f deletion is rescheduled due to dependency. [ 1407.922606] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc0215e-9e19-4ef1-8f09-6aafac54a47f" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.363511] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.363860] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.869618] env[65107]: INFO networking_nsxv3.common.synchronization [req-a9da3954-33d5-4c0b-8c78-900f9c2db63c req-30359971-d9de-42f3-af3a-e286e72a3d7a tempest-AttachVolumeNegativeTest-533228601 tempest-AttachVolumeNegativeTest-533228601-project-member] Enqueued Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_members [ 1411.870158] env[65107]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 with Priority: HIGHEST for action security_group_members [ 1411.870467] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 taken with stack trace [, , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.870592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.870677] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.870859] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.871021] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.871274] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.871340] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.871499] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.871588] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.871686] env[65107]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37d12cfe-980f-4f53-8fa1-a01fb18a7cf5',) {} {{(pid=65107) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.373799] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.374031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.374031] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.374187] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.374287] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.374490] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.374592] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.374654] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.374805] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.374877] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.374959] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 is going to be updated. [ 1412.401959] env[65107]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65107) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.402179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.402179] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.402377] env[65107]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.402526] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.410623] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 in Status: IN_PROGRESS for 2s [ 1414.421702] env[65107]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 in Status: SUCCESS [ 1414.422107] env[65107]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37d12cfe-980f-4f53-8fa1-a01fb18a7cf5 deletion is rescheduled due to dependency. [ 1414.422107] env[65107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37d12cfe-980f-4f53-8fa1-a01fb18a7cf5" {{(pid=65107) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.871753] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.872170] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.874061] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.874378] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.875303] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.875643] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.877053] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.877487] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.878567] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.879099] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.880350] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.880736] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.882427] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.882762] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.883396] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.883827] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.884694] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.885083] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.886252] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.886252] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.887747] env[65107]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.887747] env[65107]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0